-- Logs begin at Mon 2022-01-31 03:50:25 UTC, end at Mon 2022-01-31 05:11:26 UTC. -- Jan 31 04:24:47.783657 dv-cinder-826608-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 31 04:24:47.793657 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 31 04:24:47 2022] *** Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: nodename: dv-cinder-826608-2-iscsi Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: machine: x86_64 Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: clock source: unix Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: pcre jit disabled Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: detected number of CPU cores: 4 Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: current working directory: / Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: detected binary path: /usr/bin/uwsgi-core Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: your processes number limit is 47680 Jan 31 04:24:47.796304 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: your memory page size is 4096 bytes Jan 31 04:24:47.796975 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: detected max file descriptor number: 2048 Jan 31 04:24:47.796975 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: lock engine: pthread robust mutexes Jan 31 04:24:47.796975 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: thunder lock: enabled Jan 31 04:24:47.796975 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 31 04:24:47.796975 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 31 04:24:47.842029 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: Python main interpreter initialized at 0x562e2c54f9c0 Jan 31 04:24:47.842029 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: python threads support enabled Jan 31 04:24:47.842029 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: your server socket listen backlog is limited to 100 connections Jan 31 04:24:47.842029 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: your mercy for graceful operations on workers is 90 seconds Jan 31 04:24:47.842382 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: mapped 403077 bytes (393 KB) for 2 cores Jan 31 04:24:47.842458 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: *** Operational MODE: preforking *** Jan 31 04:24:47.842704 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: *** uWSGI is running in multiple interpreter mode *** Jan 31 04:24:47.842704 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: spawned uWSGI master process (pid: 79325) Jan 31 04:24:47.842922 dv-cinder-826608-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 31 04:24:47.850815 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: spawned uWSGI worker 1 (pid: 79338, cores: 1) Jan 31 04:24:47.850815 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: spawned uWSGI worker 2 (pid: 79339, cores: 1) Jan 31 04:24:47.850815 dv-cinder-826608-2-iscsi devstack@keystone.service[79325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 31 04:24:53.568851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:24:53.568851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: from cryptography.utils import int_from_bytes Jan 31 04:24:53.569644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:24:53.569644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: from cryptography.utils import int_from_bytes Jan 31 04:24:53.569644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:24:53.569644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: from cryptography.utils import int_from_bytes Jan 31 04:24:53.570165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 04:24:53.570165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: from cryptography.utils import int_from_bytes Jan 31 04:24:53.614926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 04:24:53.615118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 04:24:53.615308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] command line args: [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 04:24:53.615575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 04:24:53.615747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 04:24:53.615834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ================================================================================ {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 04:24:53.615952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 04:24:53.616037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] admin_token = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.616188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] command line args: [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 04:24:53.616268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] config_dir = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.616400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.616484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 04:24:53.616561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ================================================================================ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 04:24:53.616632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] config_source = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.616745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] debug = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.616830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] admin_token = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.616943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config_dir = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] config_source = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] debug = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.617942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] list_limit = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] log_config_append = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] log_dir = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] log_file = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.618994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_config_append = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_dir = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.619964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.620910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621098 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.621745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.622480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.622571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.622817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.622885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.622983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.623234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.623367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.623491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] publish_errors = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.623610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.623724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.623922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] publish_errors = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] standard_threads = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.624991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625676 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] standard_threads = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] use_journal = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.625914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] use_json = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] use_stderr = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] use_syslog = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_journal = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_json = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.626985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.627108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_stderr = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.627228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.627352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] use_syslog = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.627471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.627589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 04:24:53.627715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.627840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.627960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.628971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.629950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.630894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631005 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.631952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632694 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632799 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.632947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.633955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.634938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.635991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.636907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.637033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.637148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.637267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.637389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638287 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.638866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639790 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.639906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.640946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.641996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.642956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.643881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644227 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.644805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.645938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.646153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.646268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.646392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.646514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.646628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.646746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.646904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647257 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.647956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] auth.external = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.648990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] auth.password = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.649917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] auth.token = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.external = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650253 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650557 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.650917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.password = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] auth.token = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.651963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] credential.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.652952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.653187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.653799 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.653899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.653993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.654959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655081 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655212 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.655949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.656989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.657899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.658985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.659355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.659479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.659594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.659707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.659821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.659940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660178 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.660988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.661916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.662880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.663936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664629 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.664974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.665888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666227 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.666940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.667807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668247 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.668985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.669917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.670890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671253 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.671941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.672967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.673882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.674944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.675989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.676966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.677891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.678934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.679968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.680879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681227 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.681929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] role.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] role.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.682980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683446 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.683906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684244 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.684939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685387 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.685727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.686292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.686408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.686522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.686640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.686753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.686892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.687926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.688967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.689810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690023 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.690975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.691092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.691092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.691320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.691434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.691547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.691683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.691875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.692999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.693120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.693240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.693361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.693515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.693632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.693768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.694962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.695922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696035 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.connection = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696611 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.696962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.697990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.698102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.698214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.698340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.698467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.698582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.698696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.698874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.699819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.700461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.700585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.700692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.700817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.700914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.701009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 04:24:53.701104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 04:24:53.701271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 04:24:53.731271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.731435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.731505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.731641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.731757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.731873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.740384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.740611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.770843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.771065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.771228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.771464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.824067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.824514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.875861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.876091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.877298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.877537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.942408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.942630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.942831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.942922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.943939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.967927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.968870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.969002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.969085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.969213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.969305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.969428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.980511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.980963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.993948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.994984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.995067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.995206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.995287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.995443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:53.995628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 31 04:24:54.012273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.012502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 31 04:24:54.012830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.012931 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.013130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 31 04:24:54.013217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 31 04:24:54.013291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.013404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.013521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.013614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 31 04:24:54.013773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.013855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.014023 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.014104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.014349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.014606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.024708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.024981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.025246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.025406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.025523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.025687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.025955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.026237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.034296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.035027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.037512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.037783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.038247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.038529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.039988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.040281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.040571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.040652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.040836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.040929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.041106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.041217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.041383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.041485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.041655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.041745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.041926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.042010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.042190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.042282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.042535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.042824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.068642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.069452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.070204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.070483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.071073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.071354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.075804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.076028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.076299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.076550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.076830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.077110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.083953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.083953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.084304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.084589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.088155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.088438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.088712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.088987 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.089120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.089255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.089408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.089528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.089690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.089800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.089971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.090079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.090245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.090522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.091374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.091733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.109093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.109365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.110082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.110360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.113830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.114897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.117382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.117686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.118477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.118774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.123331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.124313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.126988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.128027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.130514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.130823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.131106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.131384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.131622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.131705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.131919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.132003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.132209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.132488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.132787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.133064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.150743 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.151045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.151307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.151563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.152025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.152310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.152576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.152836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.160496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.161496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.162159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.162429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.163207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.163483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.165390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.165665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.165955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.166229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.166466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.166548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.166746 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.167072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.167355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.167630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.179884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.180158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.180434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.180707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.180858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.180980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.181137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.181248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.181418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.181536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.181699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.181981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.182256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.182547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.199719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.201154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.203074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.204371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.206331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.207830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.207916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.209411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.209501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.209761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.210039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.211030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.211316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.211598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.217824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.219398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.219485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.221050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.222516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.222820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.223104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.223370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.224247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.224537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.224835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.225111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.232648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.232930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.233205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.234258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.234544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.234845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.240952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.241233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.241515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.241784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.242049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.242313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.242563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 31 04:24:54.242644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.242861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.242945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.243136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.243223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.243409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.243489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.243677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.243765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.243932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.244014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.244213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.244292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.244489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.244572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.244768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.245044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.245321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.245579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.245963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.246226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 31 04:24:54.282541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562e2c54f9c0 pid: 79338 (default app) Jan 31 04:24:54.285012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562e2c54f9c0 pid: 79339 (default app) Jan 31 04:24:54.286982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165cb5-bd6b-4126-b174-439abc0418ce None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:24:54.287275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165cb5-bd6b-4126-b174-439abc0418ce None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:24:54.287548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165cb5-bd6b-4126-b174-439abc0418ce None None] PATH_INFO: `/v3` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:24:54.291731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 791 bytes} [Mon Jan 31 04:24:54 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:03.303419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c894-0671-423d-b493-94664a3e4d5f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:03.303928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c894-0671-423d-b493-94664a3e4d5f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:03.304011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c894-0671-423d-b493-94664a3e4d5f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:03.309041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1/2] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:03.314246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:03.314647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:03.314784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:03.442068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG oslo_db.sqlalchemy.engines [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:25:03.634379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG passlib.handlers.bcrypt [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79338) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 31 04:25:03.634826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG passlib.handlers.bcrypt [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79338) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 31 04:25:03.691220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:03.692880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:03.827635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:03.983023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c894-0671-423d-b493-94664a3e4d5f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:04.016883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG oslo_db.sqlalchemy.engines [None req-6d67c894-0671-423d-b493-94664a3e4d5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 04:25:04.244742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c894-0671-423d-b493-94664a3e4d5f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:04.249436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76334c12-62bf-4953-87e0-3b9cd8ed1acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:04.250079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76334c12-62bf-4953-87e0-3b9cd8ed1acb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:04.250360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76334c12-62bf-4953-87e0-3b9cd8ed1acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:04.250632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76334c12-62bf-4953-87e0-3b9cd8ed1acb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:04.258686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76334c12-62bf-4953-87e0-3b9cd8ed1acb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:04.311566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.common.rbac_enforcer.enforcer [None req-76334c12-62bf-4953-87e0-3b9cd8ed1acb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 31 04:25:04.312088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76334c12-62bf-4953-87e0-3b9cd8ed1acb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:04.321078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 2/4] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:04.327515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:04.342341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83b38-40bf-4b1f-aece-18ff09f26679 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:04.346727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c78f99-9e94-457e-a0ad-10538d2ffa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:04.347844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c78f99-9e94-457e-a0ad-10538d2ffa4e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:04.348126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c78f99-9e94-457e-a0ad-10538d2ffa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:04.348397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c78f99-9e94-457e-a0ad-10538d2ffa4e admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:04.350013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c78f99-9e94-457e-a0ad-10538d2ffa4e admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:04.399304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0c78f99-9e94-457e-a0ad-10538d2ffa4e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 31 04:25:04.399645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c78f99-9e94-457e-a0ad-10538d2ffa4e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:04.404807 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 3/5] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:04 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:06.597848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e17e0-6939-49fc-8509-1692d088d30f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:06.598374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e17e0-6939-49fc-8509-1692d088d30f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:06.598374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e17e0-6939-49fc-8509-1692d088d30f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:06.602904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 3/6] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:06.609649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872a3e-33ab-4cce-a598-201c52a01bd6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:06.610081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872a3e-33ab-4cce-a598-201c52a01bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:06.610198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872a3e-33ab-4cce-a598-201c52a01bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:06.629591 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-1e872a3e-33ab-4cce-a598-201c52a01bd6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:06.631127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1e872a3e-33ab-4cce-a598-201c52a01bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:06.638986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:06.662544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e17e0-6939-49fc-8509-1692d088d30f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:06.674785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e17e0-6939-49fc-8509-1692d088d30f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:06.678929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a406a70-1e24-45d8-a8a6-6a5f8ef9b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:06.679539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406a70-1e24-45d8-a8a6-6a5f8ef9b3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:06.679823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406a70-1e24-45d8-a8a6-6a5f8ef9b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:06.680096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406a70-1e24-45d8-a8a6-6a5f8ef9b3a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:06.687730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a406a70-1e24-45d8-a8a6-6a5f8ef9b3a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:06.689514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a406a70-1e24-45d8-a8a6-6a5f8ef9b3a6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:06.697939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:06.703065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e872a3e-33ab-4cce-a598-201c52a01bd6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:06.711834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e872a3e-33ab-4cce-a598-201c52a01bd6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:06.717076 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef86157-ee88-4ab2-bd39-43be06397dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:06.717912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef86157-ee88-4ab2-bd39-43be06397dad admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:06.718223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef86157-ee88-4ab2-bd39-43be06397dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:06.718503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef86157-ee88-4ab2-bd39-43be06397dad admin admin] PATH_INFO: `/v3/users/2797021a13d04785b82a692e77ce62df` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:06.719912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef86157-ee88-4ab2-bd39-43be06397dad admin admin] RBAC: Authorizing `identity:get_user(user_id=2797021a13d04785b82a692e77ce62df)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:06.721725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef86157-ee88-4ab2-bd39-43be06397dad admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:06.723289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 5/9] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:06 2022] GET /identity/v3/users/2797021a13d04785b82a692e77ce62df => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:08.984851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda03f-c4c5-4cd8-b9af-666456a600f0 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:08.985382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda03f-c4c5-4cd8-b9af-666456a600f0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:08.985382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda03f-c4c5-4cd8-b9af-666456a600f0 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:08.987200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 5/10] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:08.992529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7e368-6ca5-434c-9e52-6792957f15fe None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:08.992926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7e368-6ca5-434c-9e52-6792957f15fe None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:08.993069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7e368-6ca5-434c-9e52-6792957f15fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.010293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83743-ef91-48a1-8824-926f91d4245b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.010548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83743-ef91-48a1-8824-926f91d4245b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.010847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83743-ef91-48a1-8824-926f91d4245b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.013215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-17c7e368-6ca5-434c-9e52-6792957f15fe None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:09.013515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 6/11] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:09.014522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-17c7e368-6ca5-434c-9e52-6792957f15fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:09.018207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.018493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.018769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.022117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 6/12] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:09.044870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7e368-6ca5-434c-9e52-6792957f15fe None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:09.053505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7e368-6ca5-434c-9e52-6792957f15fe None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:09.057816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:09.058581 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.059505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.059780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.060080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG passlib.handlers.bcrypt [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79339) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 31 04:25:09.060506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG passlib.handlers.bcrypt [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79339) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 31 04:25:09.072380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:09.081392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:09.081392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 7/13] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:09.086739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:09.096433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1a650-213e-40e9-b65e-63b9d0abded0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:09.100730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:09.101347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.101627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.101902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.102653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:09.102981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:09.104740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:09.104740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:09.104740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:09.105675 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:09.107301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:09.108886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:09.118484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 8/14] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:09.124465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:09.131203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 7/15] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:09.133675 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee671e-7dd6-4e1c-8320-6d96d7ddf9e0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:09.138450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:09.139296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.139573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.139844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] PATH_INFO: `/v3/users/2797021a13d04785b82a692e77ce62df` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.141040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] RBAC: Authorizing `identity:get_user(user_id=2797021a13d04785b82a692e77ce62df)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:09.142869 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:09.144381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 9/16] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:09 2022] GET /identity/v3/users/2797021a13d04785b82a692e77ce62df => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:09.149505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:09.153504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:09.161072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4787-3207-40c8-b590-5f8ca15a406a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:09.163127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731efe65-3b91-4878-ad36-e05c8b58f0ef admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:09.165414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:09.166492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.166776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.167081 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.167476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:09.168084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.169110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:09.169424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.169709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.170995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:09.172545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 8/17] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:09.177775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:09.177879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:09.179564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:09.187107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3a88a-4e56-42a4-b35e-0f35a6cffa37 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:09.188757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 10/18] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:09.191436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:09.192041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.192324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.192600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.193424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.domain.id=default, user.id=2797021a13d04785b82a692e77ce62df) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:09.193730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:09.194047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:09.195474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:09.195474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:09.195474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:09.196623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276ebe2-d2c4-4afb-8d48-292338556ac0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:09.203009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8269c3-766a-41e7-a764-972122cb85f7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:09.205412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 9/19] 10.222.0.21 () {56 vars in 1343 bytes} [Mon Jan 31 04:25:09 2022] GET /identity/v3/role_assignments?user.id=2797021a13d04785b82a692e77ce62df&scope.domain.id=default&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 233 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:09.207388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afb584-2862-41df-9ade-bed059463c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:09.208151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afb584-2862-41df-9ade-bed059463c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:09.208432 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afb584-2862-41df-9ade-bed059463c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:09.208707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afb584-2862-41df-9ade-bed059463c87 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:09.209918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afb584-2862-41df-9ade-bed059463c87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:09.211687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afb584-2862-41df-9ade-bed059463c87 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:09.213544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 11/20] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:11.552773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3dd72-0797-4ec5-9a5d-6cc18db00da7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:11.553691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3dd72-0797-4ec5-9a5d-6cc18db00da7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:11.554113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3dd72-0797-4ec5-9a5d-6cc18db00da7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:11.556310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:11.562630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a20d-b920-4042-8567-c4ce166f5acd None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:11.563482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a20d-b920-4042-8567-c4ce166f5acd None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:11.563980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22a20d-b920-4042-8567-c4ce166f5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:11.586735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-fc22a20d-b920-4042-8567-c4ce166f5acd None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:11.588192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fc22a20d-b920-4042-8567-c4ce166f5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:11.602699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 12/22] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:11.626106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3dd72-0797-4ec5-9a5d-6cc18db00da7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:11.640141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3dd72-0797-4ec5-9a5d-6cc18db00da7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:11.645080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:11.646272 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:11.646759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:11.647274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:11.664035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:11.672026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:11.678388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 11/23] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:11.680053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a20d-b920-4042-8567-c4ce166f5acd None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:11.690139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22a20d-b920-4042-8567-c4ce166f5acd None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:11.695338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:11.696309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:11.696790 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:11.697259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:11.698219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:11.698725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:11.701292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:11.715182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 13/24] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:11.716902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:11.727190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e084-bc05-41db-9745-34eb6383721b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:11.732394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:11.733633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:11.734109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:11.734579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] PATH_INFO: `/v3/users/2797021a13d04785b82a692e77ce62df` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:11.736246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] RBAC: Authorizing `identity:get_user(user_id=2797021a13d04785b82a692e77ce62df)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:11.738277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:11.742932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 12/25] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:11 2022] GET /identity/v3/users/2797021a13d04785b82a692e77ce62df => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:11.746025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:11.756421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1610bf-2b6a-4521-a676-015a718ba8c7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:11.761155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234ca00-fb07-455a-829d-32ae7c1c4efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:11.762768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ca00-fb07-455a-829d-32ae7c1c4efd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:11.763350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ca00-fb07-455a-829d-32ae7c1c4efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:11.763817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ca00-fb07-455a-829d-32ae7c1c4efd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:11.765204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234ca00-fb07-455a-829d-32ae7c1c4efd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:11.767247 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234ca00-fb07-455a-829d-32ae7c1c4efd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:11.773669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 14/26] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:11.775174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:11.786833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d01a5-1ac6-48fc-9058-b38e327a8c9c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:11.791488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a43ce-0902-4d62-ab3d-ee4c7664ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:11.792734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a43ce-0902-4d62-ab3d-ee4c7664ab58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:11.793786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a43ce-0902-4d62-ab3d-ee4c7664ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:11.794258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a43ce-0902-4d62-ab3d-ee4c7664ab58 admin admin] PATH_INFO: `/v3/domains/default/users/2797021a13d04785b82a692e77ce62df/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:11.796561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a43ce-0902-4d62-ab3d-ee4c7664ab58 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2797021a13d04785b82a692e77ce62df, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:11.797786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-3d5a43ce-0902-4d62-ab3d-ee4c7664ab58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:11.797786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:11.797786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:11.800184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a43ce-0902-4d62-ab3d-ee4c7664ab58 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:12.018994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 13/27] 10.222.0.21 () {58 vars in 1382 bytes} [Mon Jan 31 04:25:11 2022] PUT /identity/v3/domains/default/users/2797021a13d04785b82a692e77ce62df/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:12.139069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff494d00-9649-432b-8cad-2fb270a34f28 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.139501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff494d00-9649-432b-8cad-2fb270a34f28 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.139872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff494d00-9649-432b-8cad-2fb270a34f28 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.141983 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 15/28] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:12.148350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a41d92-2438-4483-86d8-086d6f1a9b09 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.148767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a41d92-2438-4483-86d8-086d6f1a9b09 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.149144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a41d92-2438-4483-86d8-086d6f1a9b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.175862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-02a41d92-2438-4483-86d8-086d6f1a9b09 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:12.177458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-02a41d92-2438-4483-86d8-086d6f1a9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:12.274899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 14/29] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:12.310547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff494d00-9649-432b-8cad-2fb270a34f28 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:12.323046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff494d00-9649-432b-8cad-2fb270a34f28 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:12.330340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:12.331153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.331432 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.331705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.347498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:12.349390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:12.368086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:25:12.369542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 16/30] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:12.374463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5720de-f587-47b8-b62d-7c9678b8e870 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.374778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5720de-f587-47b8-b62d-7c9678b8e870 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.375055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5720de-f587-47b8-b62d-7c9678b8e870 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.377884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:12.380400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 15/31] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:12.388307 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a65c24-297e-4171-b149-3f19af59d527 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.388625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a65c24-297e-4171-b149-3f19af59d527 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.388873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a65c24-297e-4171-b149-3f19af59d527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.389577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b47f14-f08d-44da-8b5c-f0f879ef1c97 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:12.399750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:12.400419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.400730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.401008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.401771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:12.402078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:12.403236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:12.403236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:12.403236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:12.404232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:12.410479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e2a65c24-297e-4171-b149-3f19af59d527 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:12.411695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e2a65c24-297e-4171-b149-3f19af59d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:12.425815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 16/32] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:12.434228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 17/33] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:12.439742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a65c24-297e-4171-b149-3f19af59d527 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:12.454498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a65c24-297e-4171-b149-3f19af59d527 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:12.459060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2102-c806-42fa-b2b8-8d670de28aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:12.460006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2102-c806-42fa-b2b8-8d670de28aaf admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.460006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2102-c806-42fa-b2b8-8d670de28aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.460275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2102-c806-42fa-b2b8-8d670de28aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.461143 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db2102-c806-42fa-b2b8-8d670de28aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:12.463866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-e3db2102-c806-42fa-b2b8-8d670de28aaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:12.463866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:12.463866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:12.465351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db2102-c806-42fa-b2b8-8d670de28aaf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:12.469088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:12.497415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb7e10-4169-4f83-936a-a978643af2a1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:12.510815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:12.510815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.510815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.510815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.511151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:12.512578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:12.512578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:12.512578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:12.513837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:12.563318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 17/34] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:25:12 2022] POST /identity/v3/projects => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:12.733133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860589-026b-44fa-b9b9-d64d4def36aa None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.733480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860589-026b-44fa-b9b9-d64d4def36aa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.733701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860589-026b-44fa-b9b9-d64d4def36aa None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.735939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 18/35] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:12.739028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 18/36] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:25:12 2022] POST /identity/v3/roles => generated 219 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:12.744099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d950f50-e4f7-41c9-a0e8-4f62311e716c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.744099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d950f50-e4f7-41c9-a0e8-4f62311e716c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.744099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d950f50-e4f7-41c9-a0e8-4f62311e716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.788228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4d950f50-e4f7-41c9-a0e8-4f62311e716c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:12.789627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4d950f50-e4f7-41c9-a0e8-4f62311e716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:12.879046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 19/37] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:12.904014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:12.921870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205d91-d31e-48a6-882e-9aba33758b95 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:12.933285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1689bb-a8f3-4932-8d4d-04c42c5d22df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:12.934493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1689bb-a8f3-4932-8d4d-04c42c5d22df admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:12.935116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1689bb-a8f3-4932-8d4d-04c42c5d22df admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:12.935590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1689bb-a8f3-4932-8d4d-04c42c5d22df admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:12.936592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1689bb-a8f3-4932-8d4d-04c42c5d22df admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:12.938651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1689bb-a8f3-4932-8d4d-04c42c5d22df admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:13.017149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 19/38] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:25:12 2022] POST /identity/v3/roles => generated 225 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:13.498681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883a32-bc08-48ea-b5f9-19d26b890665 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:13.499082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883a32-bc08-48ea-b5f9-19d26b890665 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:13.499270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883a32-bc08-48ea-b5f9-19d26b890665 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:13.501094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 20/39] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:13.506318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3013-2625-46b8-b579-40dc6e960801 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:13.506608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3013-2625-46b8-b579-40dc6e960801 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:13.506913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d3013-2625-46b8-b579-40dc6e960801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:13.524957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d96d3013-2625-46b8-b579-40dc6e960801 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:13.526467 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d96d3013-2625-46b8-b579-40dc6e960801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:13.534863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 20/40] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:13.549260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639cd64-38b3-4883-a54b-1d35554a1967 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:13.549546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639cd64-38b3-4883-a54b-1d35554a1967 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:13.549822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639cd64-38b3-4883-a54b-1d35554a1967 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:13.551906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 21/41] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:13.557680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbaa3b-ce53-4329-8355-633c0463a7f4 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:13.558053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbaa3b-ce53-4329-8355-633c0463a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:13.558248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbaa3b-ce53-4329-8355-633c0463a7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:13.559080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639cd64-38b3-4883-a54b-1d35554a1967 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:13.571365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639cd64-38b3-4883-a54b-1d35554a1967 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:13.576639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5824fd6-3dac-4c00-a7bd-d4de62960234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:13.577292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5824fd6-3dac-4c00-a7bd-d4de62960234 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:13.577577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5824fd6-3dac-4c00-a7bd-d4de62960234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:13.577866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5824fd6-3dac-4c00-a7bd-d4de62960234 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:13.578631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5824fd6-3dac-4c00-a7bd-d4de62960234 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:13.579169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-71bbaa3b-ce53-4329-8355-633c0463a7f4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:13.579688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-b5824fd6-3dac-4c00-a7bd-d4de62960234 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:13.579688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:13.579688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:13.580355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-71bbaa3b-ce53-4329-8355-633c0463a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:13.580612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5824fd6-3dac-4c00-a7bd-d4de62960234 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:13.588229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 21/42] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:13.611905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbaa3b-ce53-4329-8355-633c0463a7f4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:13.620718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbaa3b-ce53-4329-8355-633c0463a7f4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:13.625599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:13.626357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:13.626637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:13.626944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:13.628103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:13.629779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:13.631352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 22/43] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:13.636679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:13.646354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26677c-cd2a-4533-9d29-cafe0bdf92b2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:13.650683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce89088-14ba-4ca8-bd8c-a03a94829b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:13.651304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89088-14ba-4ca8-bd8c-a03a94829b38 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:13.651584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89088-14ba-4ca8-bd8c-a03a94829b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:13.651858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89088-14ba-4ca8-bd8c-a03a94829b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:13.652654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce89088-14ba-4ca8-bd8c-a03a94829b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:13.653630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-0ce89088-14ba-4ca8-bd8c-a03a94829b38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:13.653630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:13.653630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:13.654882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce89088-14ba-4ca8-bd8c-a03a94829b38 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:13.673656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 22/44] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:25:13 2022] POST /identity/v3/roles => generated 223 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:13.772098 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 23/45] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:25:13 2022] POST /identity/v3/projects => generated 312 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:25:14.642706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d584-5117-403d-9897-add36f848265 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:14.643281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d584-5117-403d-9897-add36f848265 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:14.643281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553d584-5117-403d-9897-add36f848265 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:14.645068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 23/46] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:14.650422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22eb0-2692-40f4-bd4f-0ebd5639be23 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:14.650715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22eb0-2692-40f4-bd4f-0ebd5639be23 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:14.651025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22eb0-2692-40f4-bd4f-0ebd5639be23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:14.669399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e6b22eb0-2692-40f4-bd4f-0ebd5639be23 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:14.670575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e6b22eb0-2692-40f4-bd4f-0ebd5639be23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:14.725940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 24/47] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:14.748744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553d584-5117-403d-9897-add36f848265 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:14.760788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553d584-5117-403d-9897-add36f848265 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:14.765587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:14.766360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:14.766650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:14.766967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:14.777137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:14.784856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:14.786266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 24/48] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:14.791735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22eb0-2692-40f4-bd4f-0ebd5639be23 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:14.800747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22eb0-2692-40f4-bd4f-0ebd5639be23 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:14.805024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:14.805676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:14.805955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:14.806228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:14.807031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:14.807334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:14.809193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:14.817443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 25/49] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:14.822688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:14.833424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4381491-c41c-4c0e-bbb0-82eb7fba0c8f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:14.837723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:14.838566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:14.838875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:14.839152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] PATH_INFO: `/v3/users/2797021a13d04785b82a692e77ce62df` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:14.841009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] RBAC: Authorizing `identity:get_user(user_id=2797021a13d04785b82a692e77ce62df)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:14.842866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:14.844480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 25/50] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:14 2022] GET /identity/v3/users/2797021a13d04785b82a692e77ce62df => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:14.849566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:14.859489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090893-468c-4ece-a8cc-6554cc665798 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:14.863879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fda09-2bab-4c6a-b1cd-f0519efd010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:14.864648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fda09-2bab-4c6a-b1cd-f0519efd010d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:14.864931 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fda09-2bab-4c6a-b1cd-f0519efd010d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:14.865208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fda09-2bab-4c6a-b1cd-f0519efd010d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:14.866396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fda09-2bab-4c6a-b1cd-f0519efd010d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:14.868129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fda09-2bab-4c6a-b1cd-f0519efd010d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:14.869688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 26/51] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:14.875167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:14.884522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906f1fd-148e-459e-b8c9-f4ecd38dd3ce admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:14.889439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02be48-f7ff-464b-9c87-7f5e24fdd3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:14.890071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02be48-f7ff-464b-9c87-7f5e24fdd3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:14.890352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02be48-f7ff-464b-9c87-7f5e24fdd3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:14.890626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02be48-f7ff-464b-9c87-7f5e24fdd3f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:14.891497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02be48-f7ff-464b-9c87-7f5e24fdd3f0 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.domain.id=default, user.id=2797021a13d04785b82a692e77ce62df) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:14.891808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02be48-f7ff-464b-9c87-7f5e24fdd3f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:14.893707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02be48-f7ff-464b-9c87-7f5e24fdd3f0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:14.899600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 26/52] 10.222.0.21 () {56 vars in 1343 bytes} [Mon Jan 31 04:25:14 2022] GET /identity/v3/role_assignments?user.id=2797021a13d04785b82a692e77ce62df&scope.domain.id=default&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:16.002210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014700d-c03b-406d-ad90-01e9247f85df None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:16.002751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014700d-c03b-406d-ad90-01e9247f85df None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:16.002751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014700d-c03b-406d-ad90-01e9247f85df None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:16.004554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 27/53] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:16.009877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae14a-b378-42f2-a018-ebff434775a9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:16.010251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae14a-b378-42f2-a018-ebff434775a9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:16.010432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae14a-b378-42f2-a018-ebff434775a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:16.028424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-10aae14a-b378-42f2-a018-ebff434775a9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:16.029590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-10aae14a-b378-42f2-a018-ebff434775a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:16.037122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 27/54] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:16.060872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014700d-c03b-406d-ad90-01e9247f85df None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:16.072655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014700d-c03b-406d-ad90-01e9247f85df None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:16.077079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3dd25-77ab-4de9-a4a6-0195fd131465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:16.077837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3dd25-77ab-4de9-a4a6-0195fd131465 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:16.078121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3dd25-77ab-4de9-a4a6-0195fd131465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:16.078399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3dd25-77ab-4de9-a4a6-0195fd131465 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:16.079629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3dd25-77ab-4de9-a4a6-0195fd131465 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:16.081357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3dd25-77ab-4de9-a4a6-0195fd131465 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:16.082950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 28/55] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:16.088403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae14a-b378-42f2-a018-ebff434775a9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:16.097469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae14a-b378-42f2-a018-ebff434775a9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:16.101813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acf4b0-1727-4d63-be08-84483b723ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:16.102454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf4b0-1727-4d63-be08-84483b723ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:16.102737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf4b0-1727-4d63-be08-84483b723ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:16.103048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf4b0-1727-4d63-be08-84483b723ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:16.103772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acf4b0-1727-4d63-be08-84483b723ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:16.106311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acf4b0-1727-4d63-be08-84483b723ee4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:16.193240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 28/56] 10.222.0.21 () {60 vars in 1161 bytes} [Mon Jan 31 04:25:16 2022] POST /identity/v3/projects => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:18.364752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9273d-1dcf-419e-9447-01d79cae046e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:18.365244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9273d-1dcf-419e-9447-01d79cae046e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:18.365244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9273d-1dcf-419e-9447-01d79cae046e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:18.366998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 29/57] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:18.372422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944282a4-f86b-44dd-a921-db687b39bba7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:18.372785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944282a4-f86b-44dd-a921-db687b39bba7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:18.372990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944282a4-f86b-44dd-a921-db687b39bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:18.391907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-944282a4-f86b-44dd-a921-db687b39bba7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:18.393446 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-944282a4-f86b-44dd-a921-db687b39bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:18.449390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 29/58] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:18.474103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9273d-1dcf-419e-9447-01d79cae046e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:18.486627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9273d-1dcf-419e-9447-01d79cae046e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:18.490872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03b1cb-18a1-4273-893d-615d3bb93f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:18.491642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03b1cb-18a1-4273-893d-615d3bb93f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:18.491930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03b1cb-18a1-4273-893d-615d3bb93f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:18.492206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03b1cb-18a1-4273-893d-615d3bb93f09 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:18.493391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03b1cb-18a1-4273-893d-615d3bb93f09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:18.495111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03b1cb-18a1-4273-893d-615d3bb93f09 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:18.497248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 30/59] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:18.502179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944282a4-f86b-44dd-a921-db687b39bba7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:18.510820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944282a4-f86b-44dd-a921-db687b39bba7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:18.515359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c349498-5ff4-4fa9-86f8-35a351676b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:18.516002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349498-5ff4-4fa9-86f8-35a351676b3a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:18.516290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349498-5ff4-4fa9-86f8-35a351676b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:18.516572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c349498-5ff4-4fa9-86f8-35a351676b3a admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:18.517295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349498-5ff4-4fa9-86f8-35a351676b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:18.518310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-1c349498-5ff4-4fa9-86f8-35a351676b3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:18.518310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:18.518310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:18.519567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c349498-5ff4-4fa9-86f8-35a351676b3a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:18.610091 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 30/60] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:25:18 2022] POST /identity/v3/users => generated 275 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:21.834274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8859f4-925f-4a44-92b3-ee9a0f87777d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:21.835267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8859f4-925f-4a44-92b3-ee9a0f87777d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:21.835561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8859f4-925f-4a44-92b3-ee9a0f87777d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:21.837682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 31/61] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:21.844108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18acd-6fa9-4924-af0a-acadf1da3378 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:21.844633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18acd-6fa9-4924-af0a-acadf1da3378 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:21.844707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b18acd-6fa9-4924-af0a-acadf1da3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:21.872466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e2b18acd-6fa9-4924-af0a-acadf1da3378 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:21.873697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e2b18acd-6fa9-4924-af0a-acadf1da3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:21.881901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 31/62] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:21.919044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8859f4-925f-4a44-92b3-ee9a0f87777d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:21.937360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8859f4-925f-4a44-92b3-ee9a0f87777d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:21.944039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:21.944845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:21.945136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:21.945413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:21.961063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:21.968613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:21.970069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 32/63] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:21.975491 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18acd-6fa9-4924-af0a-acadf1da3378 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:21.987736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b18acd-6fa9-4924-af0a-acadf1da3378 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:21.999445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.000126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.000411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.000690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.001469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.001782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.002832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:22.002832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:22.002832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:22.003781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.022888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 32/64] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.028590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.044860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab39db0-ad7f-456f-a4cb-830b9711174c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.049498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.050370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.050654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.050964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.071603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.074436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.076317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 33/65] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.083363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.099191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e33c0-8412-4122-90de-49b0ccd83724 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.112879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.113537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.113823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.114104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.131078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.132932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.147626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 33/66] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:22.153470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.168573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87407862-ecf2-4fac-8544-e627a71a8459 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.184140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0a136-87a9-4657-8148-cf5837663b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.185016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a136-87a9-4657-8148-cf5837663b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.185304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a136-87a9-4657-8148-cf5837663b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.185585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a136-87a9-4657-8148-cf5837663b26 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.186835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0a136-87a9-4657-8148-cf5837663b26 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.188949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0a136-87a9-4657-8148-cf5837663b26 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.190639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 34/67] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:22.196500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.211725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742d617-0ace-49ab-9131-9daa3f97270b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.219002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.219652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.219938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.220211 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.221067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=f9f0259c3b614e65a54960648e30af0d) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.221372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.223296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.228000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4939-2a8d-4b10-ac90-33e98ed2cee2 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.230960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4939-2a8d-4b10-ac90-33e98ed2cee2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.230960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4939-2a8d-4b10-ac90-33e98ed2cee2 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.230960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 35/68] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:22.234363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 34/69] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/role_assignments?user.id=f9f0259c3b614e65a54960648e30af0d&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=9d58693d11544e18a74ccda41182d77e => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.240197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356683-265d-49f9-b3c8-2db9ea6cb64a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.240740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356683-265d-49f9-b3c8-2db9ea6cb64a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.241169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86356683-265d-49f9-b3c8-2db9ea6cb64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.260328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-86356683-265d-49f9-b3c8-2db9ea6cb64a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:22.262350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-86356683-265d-49f9-b3c8-2db9ea6cb64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:22.281685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 36/70] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:22.306415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.317248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fccf5-a9fe-443e-9c94-5165978ec1b9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.331669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3e878-3f02-431c-8554-f8cda7785865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.332769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3e878-3f02-431c-8554-f8cda7785865 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.333226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3e878-3f02-431c-8554-f8cda7785865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.333669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3e878-3f02-431c-8554-f8cda7785865 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.353217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3e878-3f02-431c-8554-f8cda7785865 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:22.361662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-33c3e878-3f02-431c-8554-f8cda7785865 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:22.363191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 35/71] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:22.369223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356683-265d-49f9-b3c8-2db9ea6cb64a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.379437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86356683-265d-49f9-b3c8-2db9ea6cb64a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.391036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c0260-7a31-49d4-b54a-480448d1a71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.392963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb9ee-b4e4-4852-812c-81280596a2ef None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.393426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb9ee-b4e4-4852-812c-81280596a2ef None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.393858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecb9ee-b4e4-4852-812c-81280596a2ef None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.395623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0260-7a31-49d4-b54a-480448d1a71b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.395916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0260-7a31-49d4-b54a-480448d1a71b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.396199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0260-7a31-49d4-b54a-480448d1a71b admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.396449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 36/72] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:22.402827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c0260-7a31-49d4-b54a-480448d1a71b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.402827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c0260-7a31-49d4-b54a-480448d1a71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.402827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c0260-7a31-49d4-b54a-480448d1a71b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.415273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 37/73] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.420879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36c3c-34d9-4e51-a4e0-74ee5b012208 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.420879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36c3c-34d9-4e51-a4e0-74ee5b012208 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.420879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd36c3c-34d9-4e51-a4e0-74ee5b012208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.423951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69612bd-5f6b-4b7e-8755-361acad30d1e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.424534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69612bd-5f6b-4b7e-8755-361acad30d1e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.425308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69612bd-5f6b-4b7e-8755-361acad30d1e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.427687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 38/74] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:22.428816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69612bd-5f6b-4b7e-8755-361acad30d1e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.444930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69612bd-5f6b-4b7e-8755-361acad30d1e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.445108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cfd36c3c-34d9-4e51-a4e0-74ee5b012208 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:22.446123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cfd36c3c-34d9-4e51-a4e0-74ee5b012208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:22.450233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.451232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.451663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.452110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.453481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.455764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 37/75] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:22.455888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.457386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23541-ea7c-4f47-bbfa-04f012d8c07e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.457719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 39/76] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.458061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23541-ea7c-4f47-bbfa-04f012d8c07e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.458370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d23541-ea7c-4f47-bbfa-04f012d8c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.463696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.482358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8514eb-8d75-4e14-a024-a501856df1af admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.485925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d0d23541-ea7c-4f47-bbfa-04f012d8c07e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:22.486702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.487189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d0d23541-ea7c-4f47-bbfa-04f012d8c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:22.487421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.487706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.487977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.495479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 38/77] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:22.496901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d23541-ea7c-4f47-bbfa-04f012d8c07e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.497745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.499587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.508796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 40/78] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:22.513210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d23541-ea7c-4f47-bbfa-04f012d8c07e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.514839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.526762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9cf88-5abb-4663-9273-27af6980ff6e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.528312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.529596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.530131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.530665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.532305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.533253 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.533864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.534233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.535567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.537788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.539596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 41/79] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.544650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.548468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:22.555759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:22.556567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b8f2-05ba-453c-8014-9070b8e2ea15 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.562047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.562322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 39/80] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:22.563199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.563592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.564097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.564674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.573159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fc2b7-0a38-485f-8e70-f02eeca26a35 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.577837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.578248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:22.578516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.578820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.579101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.579947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] RBAC: Adding query filter params (role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=f9f0259c3b614e65a54960648e30af0d) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.580308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.582215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.587562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:22.588511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 40/81] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/role_assignments?user.id=f9f0259c3b614e65a54960648e30af0d&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=8fce00171f5149e2b0de6dffe397598a => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.594833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.595041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 42/82] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:22.608166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.617158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a62a1a-dffe-474c-9a28-16fcc6e7f12c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.623124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37864b3-7386-46f3-96b6-b46164338fcb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.627445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.628123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.628404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.628673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.630177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.630486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.632225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.640197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.640876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.641159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.641436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.642204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.642508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.644202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.646469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 41/83] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.647913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.659951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83859-c443-409c-8b85-99c3c4547ea6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.664802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 43/84] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:22.667105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.668046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.668410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.668604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.669805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.672611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.673943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.688314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 42/85] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.691030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bcda4-6cce-4e10-b9f0-c073e1791166 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.693577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.704952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2336d-c12d-4962-a231-63ac4cdd2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.705834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2336d-c12d-4962-a231-63ac4cdd2af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.706115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2336d-c12d-4962-a231-63ac4cdd2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.706409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2336d-c12d-4962-a231-63ac4cdd2af6 admin admin] PATH_INFO: `/v3/users/2797021a13d04785b82a692e77ce62df` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.708816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dfad9-a258-4d01-a182-b102e6184395 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.711195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2336d-c12d-4962-a231-63ac4cdd2af6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2797021a13d04785b82a692e77ce62df)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.713057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2336d-c12d-4962-a231-63ac4cdd2af6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.715445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 44/86] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/users/2797021a13d04785b82a692e77ce62df => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:22.716221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fe2a8-707f-45b5-b7df-c4ddd3a19543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.716754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606dd91-4676-4c03-bded-8162a505c950 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.717056 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606dd91-4676-4c03-bded-8162a505c950 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.717316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606dd91-4676-4c03-bded-8162a505c950 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.717720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe2a8-707f-45b5-b7df-c4ddd3a19543 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.718233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe2a8-707f-45b5-b7df-c4ddd3a19543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.718693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fe2a8-707f-45b5-b7df-c4ddd3a19543 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.718977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 45/87] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:22.723813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606dd91-4676-4c03-bded-8162a505c950 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.729240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fe2a8-707f-45b5-b7df-c4ddd3a19543 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.731617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fe2a8-707f-45b5-b7df-c4ddd3a19543 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.737245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606dd91-4676-4c03-bded-8162a505c950 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.742519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.743227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.743560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.743837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.744121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 43/88] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:22.746317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209b0e-bde1-4f95-95eb-86b6c59b0c06 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.746855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209b0e-bde1-4f95-95eb-86b6c59b0c06 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.747326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c209b0e-bde1-4f95-95eb-86b6c59b0c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.758645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.760495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.767587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6c209b0e-bde1-4f95-95eb-86b6c59b0c06 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:22.769121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6c209b0e-bde1-4f95-95eb-86b6c59b0c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:22.771534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 46/89] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:22.772503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.777998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 44/90] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:22.779117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c209b0e-bde1-4f95-95eb-86b6c59b0c06 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.789885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c209b0e-bde1-4f95-95eb-86b6c59b0c06 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.791863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e05dc4-3755-4edf-a8fc-8ca86e8bfb55 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.795841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.797192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.797505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.797885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.798389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.798495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.798699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.799092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] PATH_INFO: `/v3/projects/8373f0d8d1454fc799af9df054e97ef8` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.800308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.800437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] RBAC: Authorizing `identity:get_project(project_id=8373f0d8d1454fc799af9df054e97ef8)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.802586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.802888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.804796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 47/91] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/projects/8373f0d8d1454fc799af9df054e97ef8 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.805088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 45/92] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.810671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.811185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.820824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a6d62-b298-48f4-bc0d-6eeea5abeb0a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.821839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d55ab-e13a-4013-8594-e863e113138a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.828307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.829074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.829356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.829643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.830651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.831305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.831582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.831855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.832685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=2797021a13d04785b82a692e77ce62df) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.832992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.834887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.835711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.838019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.840741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 48/93] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.841215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.844047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 46/94] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/role_assignments?user.id=2797021a13d04785b82a692e77ce62df&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:22.845373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:22.851891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626a4f-37ce-4a29-b3fc-b5be47febef5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.857152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.857824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.858107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.858437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.858705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633c5e-b95c-4756-b979-502e687d40a3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:22.859301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=8373f0d8d1454fc799af9df054e97ef8, user.id=f9f0259c3b614e65a54960648e30af0d) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:22.859629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.860793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:22.860793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:22.860793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:22.862278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe921441-140a-4f47-94a6-80de65d7915d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.864896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0f51-f756-429e-98c6-7d1ee12472a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:22.865893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0f51-f756-429e-98c6-7d1ee12472a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:22.866407 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0f51-f756-429e-98c6-7d1ee12472a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:22.866915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0f51-f756-429e-98c6-7d1ee12472a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:22.867960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd0f51-f756-429e-98c6-7d1ee12472a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:22.870244 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd0f51-f756-429e-98c6-7d1ee12472a5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:22.874887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 49/95] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:22 2022] GET /identity/v3/role_assignments?user.id=f9f0259c3b614e65a54960648e30af0d&scope.project.id=8373f0d8d1454fc799af9df054e97ef8&role.id=9d58693d11544e18a74ccda41182d77e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:22.972660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 47/96] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:25:22 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:24.816949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065fd8-29e2-44c9-84eb-324bb12752ce None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:24.817453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065fd8-29e2-44c9-84eb-324bb12752ce None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:24.817524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065fd8-29e2-44c9-84eb-324bb12752ce None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:24.819583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 50/97] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:24.824972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e8cbb-3ea1-4e75-9d69-22e8c71bfa2b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:24.825409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e8cbb-3ea1-4e75-9d69-22e8c71bfa2b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:24.825592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e8cbb-3ea1-4e75-9d69-22e8c71bfa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:24.851810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cc2e8cbb-3ea1-4e75-9d69-22e8c71bfa2b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:24.853015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cc2e8cbb-3ea1-4e75-9d69-22e8c71bfa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:24.861624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 48/98] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:24.901047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065fd8-29e2-44c9-84eb-324bb12752ce None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:24.916789 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065fd8-29e2-44c9-84eb-324bb12752ce None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:24.925207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:24.925993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:24.926332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:24.926612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:24.941350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:24.948181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:24.949556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 51/99] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:24.955298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e8cbb-3ea1-4e75-9d69-22e8c71bfa2b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:24.968414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e8cbb-3ea1-4e75-9d69-22e8c71bfa2b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:24.978946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:24.979623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:24.979980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:24.980325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:24.981046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:24.981357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:24.983012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:24.998615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 49/100] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:25.004082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.015906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75666877-1279-483b-8110-20453eccd0b3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.022836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.023699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.023985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.024257 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.027354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.029532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.031475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 52/101] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:25.036829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.051973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56150cb4-3fdc-4e29-9876-f19ae8ff81c3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.059073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d0c18-1eaf-4745-a47c-f1a7f6963755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.059848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0c18-1eaf-4745-a47c-f1a7f6963755 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.060134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0c18-1eaf-4745-a47c-f1a7f6963755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.060413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0c18-1eaf-4745-a47c-f1a7f6963755 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.066817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d0c18-1eaf-4745-a47c-f1a7f6963755 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.066817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d0c18-1eaf-4745-a47c-f1a7f6963755 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.067986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 50/102] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:25.073530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.089464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd307f-5b4f-4bf9-862c-2559f8cdbb2b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.101692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fa2fc-987f-49c7-9035-4d3dd5959d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.102597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fa2fc-987f-49c7-9035-4d3dd5959d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.102910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fa2fc-987f-49c7-9035-4d3dd5959d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.103187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fa2fc-987f-49c7-9035-4d3dd5959d7d admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/f9f0259c3b614e65a54960648e30af0d/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.108261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fa2fc-987f-49c7-9035-4d3dd5959d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b577b01e44156a30ea00705ebb430, user_id=f9f0259c3b614e65a54960648e30af0d, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.109326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-0e3fa2fc-987f-49c7-9035-4d3dd5959d7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:25.109326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:25.109326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:25.111396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fa2fc-987f-49c7-9035-4d3dd5959d7d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.250603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 53/103] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:25 2022] PUT /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/f9f0259c3b614e65a54960648e30af0d/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:25.398436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e3b4-46ce-4701-9e34-a5462deea4b9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.399105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e3b4-46ce-4701-9e34-a5462deea4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.399610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e3b4-46ce-4701-9e34-a5462deea4b9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.401620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 51/104] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:25.407312 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feefd8-67d5-46d1-9d64-8ed432178ea7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.407611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feefd8-67d5-46d1-9d64-8ed432178ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.407885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feefd8-67d5-46d1-9d64-8ed432178ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.435928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-72feefd8-67d5-46d1-9d64-8ed432178ea7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:25.437161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-72feefd8-67d5-46d1-9d64-8ed432178ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:25.518296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 54/105] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:25.528821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8e3-d7b4-4db5-b3d2-549d97af90c7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.529431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8e3-d7b4-4db5-b3d2-549d97af90c7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.529906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8e8e3-d7b4-4db5-b3d2-549d97af90c7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.532019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 52/106] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:25.538075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d31ec-3057-44d9-87cd-fa7a5cd94c4f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.538368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d31ec-3057-44d9-87cd-fa7a5cd94c4f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.538651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d31ec-3057-44d9-87cd-fa7a5cd94c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.566002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8e3-d7b4-4db5-b3d2-549d97af90c7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.566181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-de1d31ec-3057-44d9-87cd-fa7a5cd94c4f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:25.567665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-de1d31ec-3057-44d9-87cd-fa7a5cd94c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:25.576840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 55/107] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:25.592440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8e8e3-d7b4-4db5-b3d2-549d97af90c7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.601414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.602212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.602497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.602773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.606545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d31ec-3057-44d9-87cd-fa7a5cd94c4f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.616838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d31ec-3057-44d9-87cd-fa7a5cd94c4f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.623096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.624327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.625034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.625510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.639924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:25.640709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:25.646889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:25.653806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 53/108] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:25.655035 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:25.656822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 56/109] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:25.659002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.662935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.679859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cac01-82a9-4fe5-b4b1-7353722f89b9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.680106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20c2a9-3f7c-44fd-88e7-397670c4a4d8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.685482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.686428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.686928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.687479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.688429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:25.688962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.690976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.701069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 54/110] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:25.706983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.711474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.712161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.712442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.712716 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.713493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:25.713802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.715990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.724684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 57/111] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:25.726221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28738-8eb9-4ceb-afd7-3afebbac0074 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.731981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.743506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.744251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d3636-20cb-4718-a3d9-7c51ac730527 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.744379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.744662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.744937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.747404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.749590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.751570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 55/112] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:25.757805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.763466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.764349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.764639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.764916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.766175 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.768352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.770216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 58/113] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:25.775476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.781267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4cf3-cbf2-4b4c-9858-87faff7878bf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.788373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2994398-7f34-47c9-9ad9-710ab7cdd20c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.797842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.798713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.799030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.799309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] PATH_INFO: `/v3/projects/8373f0d8d1454fc799af9df054e97ef8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.803557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] RBAC: Authorizing `identity:get_project(project_id=8373f0d8d1454fc799af9df054e97ef8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.805666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.807486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 56/114] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/projects/8373f0d8d1454fc799af9df054e97ef8 => generated 312 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:25.812412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.813280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.813561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.813838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.813999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.819548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.821702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.823425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 59/115] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:25 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:25.829605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:25.837308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c19b-a281-40f0-bead-4b49fb3acc39 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.845015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aec10a-0dd9-4d34-be35-1a23cc4550ba admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:25.852811 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26da13-c195-48c4-868d-a7536947a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.853740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26da13-c195-48c4-868d-a7536947a5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.853991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26da13-c195-48c4-868d-a7536947a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.854274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26da13-c195-48c4-868d-a7536947a5ed admin admin] PATH_INFO: `/v3/projects/8373f0d8d1454fc799af9df054e97ef8/users/f9f0259c3b614e65a54960648e30af0d/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.860124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26da13-c195-48c4-868d-a7536947a5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8373f0d8d1454fc799af9df054e97ef8, user_id=f9f0259c3b614e65a54960648e30af0d, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.862913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26da13-c195-48c4-868d-a7536947a5ed admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.863455 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:25.864347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.864634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.864912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/f9f0259c3b614e65a54960648e30af0d/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.871699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b577b01e44156a30ea00705ebb430, user_id=f9f0259c3b614e65a54960648e30af0d, role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:25.874421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:25.976592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 57/116] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:25 2022] PUT /identity/v3/projects/8373f0d8d1454fc799af9df054e97ef8/users/f9f0259c3b614e65a54960648e30af0d/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:25:25.978374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb020-902a-4665-be8f-b267df2330e8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.978831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb020-902a-4665-be8f-b267df2330e8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.979255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffb020-902a-4665-be8f-b267df2330e8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:25.982282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 58/117] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:25.988318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42ba1-79d4-4c3e-bb22-37b582f654ba None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:25.988849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42ba1-79d4-4c3e-bb22-37b582f654ba None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:25.989272 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a42ba1-79d4-4c3e-bb22-37b582f654ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.014865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 60/118] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:25 2022] PUT /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/f9f0259c3b614e65a54960648e30af0d/roles/8fce00171f5149e2b0de6dffe397598a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:25:26.023538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e1a42ba1-79d4-4c3e-bb22-37b582f654ba None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:26.025156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e1a42ba1-79d4-4c3e-bb22-37b582f654ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:26.112726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 59/119] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:26.153260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:26.167088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea116a-bac9-47f5-9459-ddf326d0f2ba admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:26.178566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:26.179418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:26.179701 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:26.179980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.201019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:26.207832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:26.209220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 61/120] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:26.215770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a42ba1-79d4-4c3e-bb22-37b582f654ba None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:26.230902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a42ba1-79d4-4c3e-bb22-37b582f654ba None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:26.236634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:26.237633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:26.238258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:26.238750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.239766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:26.240285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:26.242220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:26.257406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 60/121] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:26.263664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:26.277477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9711ce-1f5e-4f25-8a36-85afa027ad6b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:26.293767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:26.294645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:26.294957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:26.295235 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] PATH_INFO: `/v3/users/2797021a13d04785b82a692e77ce62df` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.299628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] RBAC: Authorizing `identity:get_user(user_id=2797021a13d04785b82a692e77ce62df)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:26.301487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:26.303190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 62/122] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:26 2022] GET /identity/v3/users/2797021a13d04785b82a692e77ce62df => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:26.309977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:26.322328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977b02a-9dc9-4f39-b7c5-5475d4b2173a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:26.330387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a680b6f-2d36-40d4-882b-ffa30a044fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:26.331604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680b6f-2d36-40d4-882b-ffa30a044fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:26.332094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680b6f-2d36-40d4-882b-ffa30a044fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:26.332671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680b6f-2d36-40d4-882b-ffa30a044fbb admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.335027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a680b6f-2d36-40d4-882b-ffa30a044fbb admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:26.337493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a680b6f-2d36-40d4-882b-ffa30a044fbb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:26.340018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 61/123] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:26 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:26.346549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:26.358074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5b08-084c-4bd9-a94a-6b7915ee6b95 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:26.363345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893091d-1263-46cd-8bf1-88128f582024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:26.364230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893091d-1263-46cd-8bf1-88128f582024 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:26.364509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893091d-1263-46cd-8bf1-88128f582024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:26.364786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893091d-1263-46cd-8bf1-88128f582024 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/2797021a13d04785b82a692e77ce62df/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.369906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893091d-1263-46cd-8bf1-88128f582024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b577b01e44156a30ea00705ebb430, user_id=2797021a13d04785b82a692e77ce62df, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:26.373377 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893091d-1263-46cd-8bf1-88128f582024 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:26.450406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 63/124] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:26 2022] PUT /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/2797021a13d04785b82a692e77ce62df/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:26.899205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c8ec-7f74-462b-9f4d-4a993832b569 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:26.900196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c8ec-7f74-462b-9f4d-4a993832b569 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:26.900704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c8ec-7f74-462b-9f4d-4a993832b569 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.902773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 62/125] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:26.908475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c8a80-0ede-4e73-a716-c2ec1d57c197 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:26.909235 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c8a80-0ede-4e73-a716-c2ec1d57c197 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:26.909681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c8a80-0ede-4e73-a716-c2ec1d57c197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:26.938167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c32c8a80-0ede-4e73-a716-c2ec1d57c197 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:26.939624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c32c8a80-0ede-4e73-a716-c2ec1d57c197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:27.005483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 64/126] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:27.056329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30c8ec-7f74-462b-9f4d-4a993832b569 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.075471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30c8ec-7f74-462b-9f4d-4a993832b569 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.082440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.083401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.083863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.084237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.100529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:27.108654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:27.109967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 63/127] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:27.116008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c8a80-0ede-4e73-a716-c2ec1d57c197 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.125630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c8a80-0ede-4e73-a716-c2ec1d57c197 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.135400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.136657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.137142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.137635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.138606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:27.139139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:27.140963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:27.150684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 65/128] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:27.156680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.169673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed55f84-7722-4a91-bd13-6cac3ad9f108 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.181062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.181952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.182238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.182515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] PATH_INFO: `/v3/users/59295c72e35c4657bbbd2e66f4bc1ad1` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.210714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] RBAC: Authorizing `identity:get_user(user_id=59295c72e35c4657bbbd2e66f4bc1ad1)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:27.212945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:27.218904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 64/129] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:27 2022] GET /identity/v3/users/59295c72e35c4657bbbd2e66f4bc1ad1 => generated 289 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:27.221218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.241626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f556d42-ab5f-43dc-99c8-f764b5d4c67d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.267691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.268731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.270919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.271404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.291348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:27.293640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:27.312339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 66/130] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:27.328354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.352043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23991e-742c-42a1-97c7-9a1e87673bdb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.362371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a52054-5d7a-4d88-8e0d-cbb0e26f61c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.363285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52054-5d7a-4d88-8e0d-cbb0e26f61c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.363577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52054-5d7a-4d88-8e0d-cbb0e26f61c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.366810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52054-5d7a-4d88-8e0d-cbb0e26f61c8 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.366810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a52054-5d7a-4d88-8e0d-cbb0e26f61c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:27.367389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a52054-5d7a-4d88-8e0d-cbb0e26f61c8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:27.374060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 65/131] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:27 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:27.379901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.403161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e21caf-f97b-4784-8c8f-78d93ae6350e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.431466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ee065-5800-4b8d-a1bb-58e99e7fd52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.432452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee065-5800-4b8d-a1bb-58e99e7fd52f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.433051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee065-5800-4b8d-a1bb-58e99e7fd52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.433553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ee065-5800-4b8d-a1bb-58e99e7fd52f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.434718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ee065-5800-4b8d-a1bb-58e99e7fd52f admin admin] RBAC: Adding query filter params (role.id=952841af23ec49cb83f92fb44ffdbf17, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=59295c72e35c4657bbbd2e66f4bc1ad1) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:27.436054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ee065-5800-4b8d-a1bb-58e99e7fd52f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:27.438126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ee065-5800-4b8d-a1bb-58e99e7fd52f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:27.450848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 67/132] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:27 2022] GET /identity/v3/role_assignments?user.id=59295c72e35c4657bbbd2e66f4bc1ad1&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=952841af23ec49cb83f92fb44ffdbf17 => generated 259 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:27.838619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1de178-fc01-48f5-afe9-32bec0eb0c8f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.839017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1de178-fc01-48f5-afe9-32bec0eb0c8f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.839793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1de178-fc01-48f5-afe9-32bec0eb0c8f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.842017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 66/133] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:27.849194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef0b9-8284-4e6e-94d7-43053d3c8d39 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.849194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef0b9-8284-4e6e-94d7-43053d3c8d39 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.849194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef0b9-8284-4e6e-94d7-43053d3c8d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.876011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c66ef0b9-8284-4e6e-94d7-43053d3c8d39 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:27.877338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c66ef0b9-8284-4e6e-94d7-43053d3c8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:27.888502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 68/134] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:27.925190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1de178-fc01-48f5-afe9-32bec0eb0c8f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.945012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1de178-fc01-48f5-afe9-32bec0eb0c8f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.954255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7673d0a-78a4-4ff4-9023-7e791864aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.955064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673d0a-78a4-4ff4-9023-7e791864aed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.955346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673d0a-78a4-4ff4-9023-7e791864aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.955728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7673d0a-78a4-4ff4-9023-7e791864aed4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.956791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7673d0a-78a4-4ff4-9023-7e791864aed4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:27.958486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7673d0a-78a4-4ff4-9023-7e791864aed4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:27.960101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 67/135] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:27.967049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef0b9-8284-4e6e-94d7-43053d3c8d39 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:27.980037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef0b9-8284-4e6e-94d7-43053d3c8d39 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:27.996411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e8ef7-ecac-4028-bb72-9b8017b8f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:27.997166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8ef7-ecac-4028-bb72-9b8017b8f09f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:27.997485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8ef7-ecac-4028-bb72-9b8017b8f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:27.997781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8ef7-ecac-4028-bb72-9b8017b8f09f admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:27.998527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e8ef7-ecac-4028-bb72-9b8017b8f09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:28.000499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e8ef7-ecac-4028-bb72-9b8017b8f09f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:28.109946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 69/136] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:25:27 2022] POST /identity/v3/projects => generated 302 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:28.808587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f600b-3a54-4eb3-82e8-ec1203ca6a97 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:28.809135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f600b-3a54-4eb3-82e8-ec1203ca6a97 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:28.809135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f600b-3a54-4eb3-82e8-ec1203ca6a97 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:28.811250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 68/137] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:28.816795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa06bf-d2e8-4d92-8ffb-64bd4ec4c2be None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:28.817070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa06bf-d2e8-4d92-8ffb-64bd4ec4c2be None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:28.817345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa06bf-d2e8-4d92-8ffb-64bd4ec4c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:28.836013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d7aa06bf-d2e8-4d92-8ffb-64bd4ec4c2be None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:28.837347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d7aa06bf-d2e8-4d92-8ffb-64bd4ec4c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:28.914326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 70/138] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:28.942426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f600b-3a54-4eb3-82e8-ec1203ca6a97 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:28.955363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f600b-3a54-4eb3-82e8-ec1203ca6a97 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:28.962250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:28.963078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:28.963362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:28.963638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:28.975571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:28.986508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:28.988127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 69/139] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:28.993760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa06bf-d2e8-4d92-8ffb-64bd4ec4c2be None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.003170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa06bf-d2e8-4d92-8ffb-64bd4ec4c2be None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.007567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.008224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.008502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.008779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.009545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:29.009850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.012054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.026397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 71/140] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.032445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.047099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98dd55-9dd2-4cc0-96f8-6f48143171ff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.051708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.052576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.052859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.053131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.054339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.056526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.059247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 70/141] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.063850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.074299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1395e-d5fa-48fb-b3b1-dc7d7516a6c8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.078632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.084028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.084314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.084595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.103915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.106285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.120780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 72/142] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:29.126673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.138159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31281586-95e4-4fef-b325-36f5deddbbef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.143277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0a9d-e9fe-4ed9-a026-7e6ba0206ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.144498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0a9d-e9fe-4ed9-a026-7e6ba0206ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.144981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0a9d-e9fe-4ed9-a026-7e6ba0206ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.145459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0a9d-e9fe-4ed9-a026-7e6ba0206ae2 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.147104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0a9d-e9fe-4ed9-a026-7e6ba0206ae2 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.149471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0a9d-e9fe-4ed9-a026-7e6ba0206ae2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.151733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 71/143] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.157961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.167912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507da2-a783-4d23-863b-efbc78a428e6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.172996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc36037-a30c-40d5-8020-6fe6ecbf9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.173910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36037-a30c-40d5-8020-6fe6ecbf9a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.174384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36037-a30c-40d5-8020-6fe6ecbf9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.174884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc36037-a30c-40d5-8020-6fe6ecbf9a30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.175972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc36037-a30c-40d5-8020-6fe6ecbf9a30 admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=f9f0259c3b614e65a54960648e30af0d) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:29.176509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc36037-a30c-40d5-8020-6fe6ecbf9a30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.178666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc36037-a30c-40d5-8020-6fe6ecbf9a30 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.185868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 73/144] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/role_assignments?user.id=f9f0259c3b614e65a54960648e30af0d&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=9d58693d11544e18a74ccda41182d77e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.398265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bc0a-9fe7-4645-adff-33c4a39e592d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.398988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bc0a-9fe7-4645-adff-33c4a39e592d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.399495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bc0a-9fe7-4645-adff-33c4a39e592d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.402049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 72/145] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:29.407584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1017c-6b2c-45df-a0f8-c047bd90e52b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.408388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1017c-6b2c-45df-a0f8-c047bd90e52b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.408855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1017c-6b2c-45df-a0f8-c047bd90e52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.414436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c2baf-2c10-4d09-b14b-30eb8dccb035 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.415015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c2baf-2c10-4d09-b14b-30eb8dccb035 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.415488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c2baf-2c10-4d09-b14b-30eb8dccb035 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.417580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 73/146] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:29.422668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b1ad-6ffc-48b5-b60b-ffd63f2fdf5d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.423310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b1ad-6ffc-48b5-b60b-ffd63f2fdf5d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.423794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156b1ad-6ffc-48b5-b60b-ffd63f2fdf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.435770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e2c1017c-6b2c-45df-a0f8-c047bd90e52b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:29.438816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e2c1017c-6b2c-45df-a0f8-c047bd90e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:29.451394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 74/147] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:29.455191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c156b1ad-6ffc-48b5-b60b-ffd63f2fdf5d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:29.456374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c156b1ad-6ffc-48b5-b60b-ffd63f2fdf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:29.464524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 74/148] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:29.489250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1017c-6b2c-45df-a0f8-c047bd90e52b None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.496733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156b1ad-6ffc-48b5-b60b-ffd63f2fdf5d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.501851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1017c-6b2c-45df-a0f8-c047bd90e52b None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.511360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.512172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.512502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.512777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.517072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156b1ad-6ffc-48b5-b60b-ffd63f2fdf5d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.526130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.528987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.529285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.531458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.534624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:29.550004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:29.552100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 75/149] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:29.555062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:29.562484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.570591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:29.573089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 75/150] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:29.577353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa201f-3f98-4edf-8a1c-98262d6fa8f3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.580612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.594374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.595333 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.595620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.595897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.597602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:29.597911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.601300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5db54-a4f4-49dc-a06e-872da241fe06 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.602256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.612019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.612770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.613060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.613336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.615984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:29.616302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.619432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.622229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 76/151] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:29.627832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.634578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 76/152] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.642747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064512cb-2814-4d73-8ead-ac2e6f8e9431 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.646493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.650971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.652001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.652250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.652641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.654374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.656682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.658600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 77/153] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:29.666197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5e83e-10c1-477d-8c0e-5f31004e112a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.670583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.681043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.683259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.683551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.683832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] PATH_INFO: `/v3/users/f9f0259c3b614e65a54960648e30af0d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.686548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9f0259c3b614e65a54960648e30af0d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.688259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4e849-7b7c-4bb9-9e59-57dcd31be3a1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.690919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.693552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 77/154] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/users/f9f0259c3b614e65a54960648e30af0d => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:29.700152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.701661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.702370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.702657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.702994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.716768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f61936-79f2-44c2-9503-f4e6746c7678 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.720071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.722083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.730334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.731280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.731756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.732220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.743190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 78/155] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:29.748213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.749048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.749525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.764184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 78/156] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:29.768146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.769570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53616ca2-a7be-40da-a0fe-4e7e84eb38c8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.778812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61348b4-c150-49ee-bc6d-e000fc77568b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.787359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.788559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.789028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.789407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.789630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] PATH_INFO: `/v3/projects/8373f0d8d1454fc799af9df054e97ef8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.790466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.790955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.791320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.791626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] RBAC: Authorizing `identity:get_project(project_id=8373f0d8d1454fc799af9df054e97ef8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.793281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.795037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.795732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.797102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 79/157] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/projects/8373f0d8d1454fc799af9df054e97ef8 => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.799984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 79/158] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.802973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.807318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:29.819420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d49b5-bf9b-4197-be61-7cb14ed56ccf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.824904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fad40a-b431-40fd-9511-40f66e1c6acb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:29.830245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15db7c1-84cc-45b7-b7e6-cd651dacebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.831142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15db7c1-84cc-45b7-b7e6-cd651dacebd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.832018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15db7c1-84cc-45b7-b7e6-cd651dacebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.832808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15db7c1-84cc-45b7-b7e6-cd651dacebd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.834315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15db7c1-84cc-45b7-b7e6-cd651dacebd7 admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=8373f0d8d1454fc799af9df054e97ef8, user.id=f9f0259c3b614e65a54960648e30af0d) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:29.835045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa0b8e-6900-475a-a129-6d66cae2c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:29.835875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0b8e-6900-475a-a129-6d66cae2c97f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.836378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15db7c1-84cc-45b7-b7e6-cd651dacebd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.836855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0b8e-6900-475a-a129-6d66cae2c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.838935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15db7c1-84cc-45b7-b7e6-cd651dacebd7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.839603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0b8e-6900-475a-a129-6d66cae2c97f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.840626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0b8e-6900-475a-a129-6d66cae2c97f admin admin] RBAC: Adding query filter params (role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=f9f0259c3b614e65a54960648e30af0d) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:29.841141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0b8e-6900-475a-a129-6d66cae2c97f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:29.843220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0b8e-6900-475a-a129-6d66cae2c97f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:29.851833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 80/159] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/role_assignments?user.id=f9f0259c3b614e65a54960648e30af0d&scope.project.id=8373f0d8d1454fc799af9df054e97ef8&role.id=9d58693d11544e18a74ccda41182d77e => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:29.861306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 80/160] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/role_assignments?user.id=f9f0259c3b614e65a54960648e30af0d&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=8fce00171f5149e2b0de6dffe397598a => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:29.894840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c1bc6-8024-4d89-983c-2b6ede2e609c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.895485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c1bc6-8024-4d89-983c-2b6ede2e609c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.895991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c1bc6-8024-4d89-983c-2b6ede2e609c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.898042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 81/161] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:29.915292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19836c-1d6e-43ce-ba21-08d28c3a8c78 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:29.915914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19836c-1d6e-43ce-ba21-08d28c3a8c78 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:29.916390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19836c-1d6e-43ce-ba21-08d28c3a8c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:29.944037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-0f19836c-1d6e-43ce-ba21-08d28c3a8c78 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:29.945580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0f19836c-1d6e-43ce-ba21-08d28c3a8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:29.954540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 81/162] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:29.991128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c1bc6-8024-4d89-983c-2b6ede2e609c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.008684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c1bc6-8024-4d89-983c-2b6ede2e609c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.019311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.020485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.020962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.021450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.040859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:30.048191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:30.049751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 82/163] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:30.055778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19836c-1d6e-43ce-ba21-08d28c3a8c78 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.067670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19836c-1d6e-43ce-ba21-08d28c3a8c78 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.074831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.075872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.076359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.076818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.077777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:30.078281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.080230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.097587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 82/164] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:30.102205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.113748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25b1f-6079-402c-8346-1fadf12c7fbf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.123981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.124931 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.125209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.125478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] PATH_INFO: `/v3/users/2797021a13d04785b82a692e77ce62df` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.127385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] RBAC: Authorizing `identity:get_user(user_id=2797021a13d04785b82a692e77ce62df)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.129332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.131400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 83/165] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/users/2797021a13d04785b82a692e77ce62df => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:30.137706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.148225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bae914-a48f-46fc-a4ff-1fa98288401c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.154728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.155465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.155748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.156016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.165664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.167609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.178001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 83/166] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:30.183812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.193704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2efed-473d-4dba-b1c8-113d3f615c2f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.198140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db051ca1-f01d-4abd-b1f6-0442dc95b4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.199186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051ca1-f01d-4abd-b1f6-0442dc95b4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.199457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051ca1-f01d-4abd-b1f6-0442dc95b4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.199721 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051ca1-f01d-4abd-b1f6-0442dc95b4c4 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.200926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db051ca1-f01d-4abd-b1f6-0442dc95b4c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.203027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db051ca1-f01d-4abd-b1f6-0442dc95b4c4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.204926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 84/167] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:30.210531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.220289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ce7e0-4735-40ae-85af-8a01effc38be admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.226662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83987c-db11-493f-9b81-aa9aa4783d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.227370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83987c-db11-493f-9b81-aa9aa4783d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.227647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83987c-db11-493f-9b81-aa9aa4783d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.227919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83987c-db11-493f-9b81-aa9aa4783d77 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.228775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83987c-db11-493f-9b81-aa9aa4783d77 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=2797021a13d04785b82a692e77ce62df) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:30.229079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83987c-db11-493f-9b81-aa9aa4783d77 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.231224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83987c-db11-493f-9b81-aa9aa4783d77 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.238358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 84/168] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/role_assignments?user.id=2797021a13d04785b82a692e77ce62df&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:30.744128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1267582-c9df-4e30-8125-8aa1c4de96c9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.744417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1267582-c9df-4e30-8125-8aa1c4de96c9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.744695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1267582-c9df-4e30-8125-8aa1c4de96c9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.747165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 85/169] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:30.752297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade685df-4a81-4a64-a84e-d164e38ab51d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.752657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade685df-4a81-4a64-a84e-d164e38ab51d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.753003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade685df-4a81-4a64-a84e-d164e38ab51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.771061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ade685df-4a81-4a64-a84e-d164e38ab51d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:30.772231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ade685df-4a81-4a64-a84e-d164e38ab51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:30.779690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 85/170] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:30.802334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1267582-c9df-4e30-8125-8aa1c4de96c9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.814783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1267582-c9df-4e30-8125-8aa1c4de96c9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.818986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.819749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.820032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.820308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.830846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:30.837615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:30.838782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 86/171] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:30.844642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade685df-4a81-4a64-a84e-d164e38ab51d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.853506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade685df-4a81-4a64-a84e-d164e38ab51d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.857803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.858447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.858727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.859084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.859848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:30.860153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.861761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.869827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 86/172] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:30.875577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.884932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054bf4-21e3-4c76-8f71-c79697c11160 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.889184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.890023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.890305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.890580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] PATH_INFO: `/v3/users/59295c72e35c4657bbbd2e66f4bc1ad1` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.891801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=59295c72e35c4657bbbd2e66f4bc1ad1)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.893947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.895558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 87/173] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/users/59295c72e35c4657bbbd2e66f4bc1ad1 => generated 289 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:30.900736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.911265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cbe72-9bdc-422d-abd4-1e070eef876e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.915466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398a9aa-7339-4276-b5ac-7c40f40801fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.916296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a9aa-7339-4276-b5ac-7c40f40801fb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.916577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a9aa-7339-4276-b5ac-7c40f40801fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.916853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a9aa-7339-4276-b5ac-7c40f40801fb admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.918443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398a9aa-7339-4276-b5ac-7c40f40801fb admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.920530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398a9aa-7339-4276-b5ac-7c40f40801fb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:30.922159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 87/174] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:30 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:30.927573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:30.938879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f624ef-b777-43e0-8178-edfa766a02a7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:30.943156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb41929-a0cf-4cfb-a23f-ea33a2d743df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:30.944012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41929-a0cf-4cfb-a23f-ea33a2d743df admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:30.944294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41929-a0cf-4cfb-a23f-ea33a2d743df admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:30.944568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb41929-a0cf-4cfb-a23f-ea33a2d743df admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/59295c72e35c4657bbbd2e66f4bc1ad1/roles/952841af23ec49cb83f92fb44ffdbf17` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:30.946541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb41929-a0cf-4cfb-a23f-ea33a2d743df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b577b01e44156a30ea00705ebb430, user_id=59295c72e35c4657bbbd2e66f4bc1ad1, role_id=952841af23ec49cb83f92fb44ffdbf17)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:30.949989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb41929-a0cf-4cfb-a23f-ea33a2d743df admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:31.061570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 88/175] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:30 2022] PUT /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430/users/59295c72e35c4657bbbd2e66f4bc1ad1/roles/952841af23ec49cb83f92fb44ffdbf17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:25:31.337565 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd1b3-31fc-4f5c-a369-e9f85e3857fd None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:31.417586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd1b3-31fc-4f5c-a369-e9f85e3857fd None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:31.417586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd1b3-31fc-4f5c-a369-e9f85e3857fd None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:31.417586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 88/176] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:31.417880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364827-9ebd-467a-85ba-9b6b7f7bbfea None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:31.417880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364827-9ebd-467a-85ba-9b6b7f7bbfea None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:31.417880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6364827-9ebd-467a-85ba-9b6b7f7bbfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:31.417880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a6364827-9ebd-467a-85ba-9b6b7f7bbfea None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:31.417880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a6364827-9ebd-467a-85ba-9b6b7f7bbfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:31.428121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 89/177] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:31.453415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd1b3-31fc-4f5c-a369-e9f85e3857fd None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:31.465451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd1b3-31fc-4f5c-a369-e9f85e3857fd None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:31.469665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d899904-b04f-43ee-b4d9-ba06c50d5bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:31.470426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d899904-b04f-43ee-b4d9-ba06c50d5bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:31.470704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d899904-b04f-43ee-b4d9-ba06c50d5bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:31.471016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d899904-b04f-43ee-b4d9-ba06c50d5bbc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:31.472176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d899904-b04f-43ee-b4d9-ba06c50d5bbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:31.473854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d899904-b04f-43ee-b4d9-ba06c50d5bbc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:31.475443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 89/178] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:31.480620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6364827-9ebd-467a-85ba-9b6b7f7bbfea None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:31.489398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6364827-9ebd-467a-85ba-9b6b7f7bbfea None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:31.493660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4c4d2-7125-4fda-960f-762fa9a88ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:31.494301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c4d2-7125-4fda-960f-762fa9a88ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:31.494580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c4d2-7125-4fda-960f-762fa9a88ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:31.494880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4c4d2-7125-4fda-960f-762fa9a88ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:31.496158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4c4d2-7125-4fda-960f-762fa9a88ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:31.498126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4c4d2-7125-4fda-960f-762fa9a88ce0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:31.586529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 90/179] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:25:31 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:33.275830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013780-6177-4a78-9686-16cd4301e833 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.277355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013780-6177-4a78-9686-16cd4301e833 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.277854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013780-6177-4a78-9686-16cd4301e833 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.279857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 90/180] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:33.285458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21005c1-6548-4e8b-9464-888743f5e9d6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.285885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21005c1-6548-4e8b-9464-888743f5e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.286063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21005c1-6548-4e8b-9464-888743f5e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.303724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e21005c1-6548-4e8b-9464-888743f5e9d6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:33.304910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e21005c1-6548-4e8b-9464-888743f5e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:33.312970 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 91/181] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:33.339386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8013780-6177-4a78-9686-16cd4301e833 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:33.351821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8013780-6177-4a78-9686-16cd4301e833 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:33.356747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:33.357524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.357802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.358075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.369083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:33.376021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:33.377228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 91/182] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:33.383106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21005c1-6548-4e8b-9464-888743f5e9d6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:33.392787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21005c1-6548-4e8b-9464-888743f5e9d6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:33.397324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:33.398022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.398306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.398577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.399380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:33.399683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:33.401441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:33.410640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 92/183] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:33.415971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:33.427365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6704f6b-1e70-4bc3-8dd3-d8a786146602 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:33.431821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:33.432727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.433221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.433507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] PATH_INFO: `/v3/users/59295c72e35c4657bbbd2e66f4bc1ad1` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.434734 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] RBAC: Authorizing `identity:get_user(user_id=59295c72e35c4657bbbd2e66f4bc1ad1)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:33.436921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:33.438848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 92/184] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:33 2022] GET /identity/v3/users/59295c72e35c4657bbbd2e66f4bc1ad1 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:33.444264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:33.454911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382fd5b-afb5-4e89-a95c-238e16d79a73 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:33.459233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:33.459873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.460155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.460429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.468732 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:33.470499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:33.479976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 93/185] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:33.485590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:33.495607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec6168-7dba-4a13-827a-73687572d7ff admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:33.500068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be9a03-f529-4a59-a7bd-8e64f4bad170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:33.500905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be9a03-f529-4a59-a7bd-8e64f4bad170 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.501187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be9a03-f529-4a59-a7bd-8e64f4bad170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.501459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be9a03-f529-4a59-a7bd-8e64f4bad170 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.502665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be9a03-f529-4a59-a7bd-8e64f4bad170 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:33.504817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be9a03-f529-4a59-a7bd-8e64f4bad170 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:33.506535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 93/186] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:33 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:33.513295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:33.522347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810de33-d342-4a82-bf2f-4974285a6687 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:33.526927 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb577942-d2b6-448e-8848-31e0e8270a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:33.527654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577942-d2b6-448e-8848-31e0e8270a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.527936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577942-d2b6-448e-8848-31e0e8270a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.528220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb577942-d2b6-448e-8848-31e0e8270a66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.529066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577942-d2b6-448e-8848-31e0e8270a66 admin admin] RBAC: Adding query filter params (role.id=952841af23ec49cb83f92fb44ffdbf17, scope.project.id=0d7b577b01e44156a30ea00705ebb430, user.id=59295c72e35c4657bbbd2e66f4bc1ad1) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:33.529369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577942-d2b6-448e-8848-31e0e8270a66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:33.531240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb577942-d2b6-448e-8848-31e0e8270a66 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:33.537976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 94/187] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:33 2022] GET /identity/v3/role_assignments?user.id=59295c72e35c4657bbbd2e66f4bc1ad1&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=952841af23ec49cb83f92fb44ffdbf17 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:33.954578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c702a-69da-4d05-bffa-24cef715303d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.954973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c702a-69da-4d05-bffa-24cef715303d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.955162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c702a-69da-4d05-bffa-24cef715303d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.957058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 94/188] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:33.962068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62705-19d4-455f-b9b8-f9c726751082 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:33.962428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62705-19d4-455f-b9b8-f9c726751082 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:33.962771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62705-19d4-455f-b9b8-f9c726751082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:33.981558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-aae62705-19d4-455f-b9b8-f9c726751082 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:33.982739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-aae62705-19d4-455f-b9b8-f9c726751082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:33.990552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 95/189] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:34.013637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c702a-69da-4d05-bffa-24cef715303d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.025471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c702a-69da-4d05-bffa-24cef715303d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.030422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.031236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.031516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.031784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.040707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b541a-041e-403d-900b-d14ac8919056 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.040995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b541a-041e-403d-900b-d14ac8919056 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.041267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b541a-041e-403d-900b-d14ac8919056 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.042471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:34.043472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 96/190] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:34.048176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb0de-6bd4-4e6b-944e-2a7d2235a19b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.048462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb0de-6bd4-4e6b-944e-2a7d2235a19b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.048734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb0de-6bd4-4e6b-944e-2a7d2235a19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.049239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:34.050404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 95/191] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:34.055947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.065694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2c084-fa20-4931-b752-b38e0f0d2360 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.066644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f35bb0de-6bd4-4e6b-944e-2a7d2235a19b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:34.067838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f35bb0de-6bd4-4e6b-944e-2a7d2235a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:34.070008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.070648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.070973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.071252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.072014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:34.072315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.074606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.076279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 97/192] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:34.083224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460908-cfd2-4f5a-a5a6-f693ac965387 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.083667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460908-cfd2-4f5a-a5a6-f693ac965387 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.084136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 96/193] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:34.085025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460908-cfd2-4f5a-a5a6-f693ac965387 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.086983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 98/194] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:34.089984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.092843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d06d3d-b6ab-4085-ad31-b317a8a25087 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.093131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d06d3d-b6ab-4085-ad31-b317a8a25087 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.093404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d06d3d-b6ab-4085-ad31-b317a8a25087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.100693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d154d6c-4cb4-4109-b31f-96b404b40143 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.105003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.105846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.106124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.106398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] PATH_INFO: `/v3/users/d39feaf9debe42b681d75e532d7ed8f8` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.110677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-71d06d3d-b6ab-4085-ad31-b317a8a25087 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:34.111867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-71d06d3d-b6ab-4085-ad31-b317a8a25087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:34.119471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 99/195] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:34.123002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] RBAC: Authorizing `identity:get_user(user_id=d39feaf9debe42b681d75e532d7ed8f8)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.123090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d06d3d-b6ab-4085-ad31-b317a8a25087 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.123164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.123598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 97/196] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/users/d39feaf9debe42b681d75e532d7ed8f8 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:34.129655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d06d3d-b6ab-4085-ad31-b317a8a25087 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.131860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.133949 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.134708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.135178 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.135455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.141617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca04c0-b5f9-4106-9a47-b41c0af55b11 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.146180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:34.146461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.147109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.147393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.147672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.154094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:34.155329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 100/197] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:34.156403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.157102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.158417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.166436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbd0f7-771e-4ab0-8e3f-df9602cf2f3d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.167414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 98/198] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:34.169250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.171170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.171995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.172274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.172542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.173692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.175406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.176952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 101/199] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:34.177671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.177912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eac75b-4da2-4f3f-a8ee-173886afb376 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.183989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.184618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.184897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.185170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.185921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:34.186224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.187838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.190568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e7a8-bf4b-48c0-ab96-bdc3434a6ca1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.194810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.195592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.195862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.195954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 99/200] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:34.196192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.197403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.199986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.200200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.201921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 102/201] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:34.202636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.209291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c73bbb-bd89-4486-9158-0495c26ce8a4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.211889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdce12-dfeb-4c4c-a977-6d1b78e240e3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.213386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2ddb-4c55-4e85-9f85-b813ad1884c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.214642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2ddb-4c55-4e85-9f85-b813ad1884c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.215169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2ddb-4c55-4e85-9f85-b813ad1884c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.215557 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2ddb-4c55-4e85-9f85-b813ad1884c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.216274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2ddb-4c55-4e85-9f85-b813ad1884c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.217185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.217327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-706b2ddb-4c55-4e85-9f85-b813ad1884c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:34.217327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:34.217327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:34.217972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.218245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.218456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2ddb-4c55-4e85-9f85-b813ad1884c0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.218554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] PATH_INFO: `/v3/users/d39feaf9debe42b681d75e532d7ed8f8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.219718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] RBAC: Authorizing `identity:get_user(user_id=d39feaf9debe42b681d75e532d7ed8f8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.221760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.227407 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 103/202] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/users/d39feaf9debe42b681d75e532d7ed8f8 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:34.227407 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.236349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5216565-1561-4865-a120-b70b085c9758 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.240492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.241059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.241334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.241603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.242405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=d39feaf9debe42b681d75e532d7ed8f8) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:34.242701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.244814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.250218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 104/203] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/role_assignments?user.id=d39feaf9debe42b681d75e532d7ed8f8&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:34.254843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.260036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957401ca-c934-4b01-b3d2-a53a041e3ecd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.265745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.266419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.266762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.267064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.275856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.278590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.288660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 105/204] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:34.294633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.303767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4a4cf-0769-423c-aed7-be03dafd376c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.308534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.309481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.309713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.312308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.312308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.313706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.315532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 106/205] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:34.321410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:34.332251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e94225-eaa2-4d5f-8a85-17ca5b443739 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:34.336619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20fafc-965f-41fa-adef-4d2d04c61e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:34.337269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20fafc-965f-41fa-adef-4d2d04c61e98 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:34.337554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20fafc-965f-41fa-adef-4d2d04c61e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:34.337971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20fafc-965f-41fa-adef-4d2d04c61e98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:34.338682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20fafc-965f-41fa-adef-4d2d04c61e98 admin admin] RBAC: Adding query filter params (role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=d39feaf9debe42b681d75e532d7ed8f8) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:34.339107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20fafc-965f-41fa-adef-4d2d04c61e98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:34.343617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20fafc-965f-41fa-adef-4d2d04c61e98 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:34.345680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 100/206] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:25:34 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:34.349921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 107/207] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:34 2022] GET /identity/v3/role_assignments?user.id=d39feaf9debe42b681d75e532d7ed8f8&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=8fce00171f5149e2b0de6dffe397598a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:36.533703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab929629-9347-413f-8cd1-b2b5e3b4ee7f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.534225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab929629-9347-413f-8cd1-b2b5e3b4ee7f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.534225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab929629-9347-413f-8cd1-b2b5e3b4ee7f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.536499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 101/208] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:36.544751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efed1d-b78b-40e5-a0d9-7addc721d6d3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.544751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efed1d-b78b-40e5-a0d9-7addc721d6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.544751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efed1d-b78b-40e5-a0d9-7addc721d6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.563967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b2efed1d-b78b-40e5-a0d9-7addc721d6d3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:36.565520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b2efed1d-b78b-40e5-a0d9-7addc721d6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:36.578889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 108/209] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:36.598946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab929629-9347-413f-8cd1-b2b5e3b4ee7f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.612197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab929629-9347-413f-8cd1-b2b5e3b4ee7f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.616902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.617930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.618409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.618909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.630646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:36.638020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:36.639477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 102/210] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:36.645814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efed1d-b78b-40e5-a0d9-7addc721d6d3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.656603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efed1d-b78b-40e5-a0d9-7addc721d6d3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.662039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.663142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.663635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.664114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.665095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:36.665601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:36.667588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:36.677637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 109/211] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:36.684494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.695639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ed6b7-06c5-42a1-889d-6f64e676abe5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.700527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.701579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.702044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.702499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] PATH_INFO: `/v3/users/d39feaf9debe42b681d75e532d7ed8f8` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.703923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] RBAC: Authorizing `identity:get_user(user_id=d39feaf9debe42b681d75e532d7ed8f8)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:36.706302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:36.712558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 103/212] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:36 2022] GET /identity/v3/users/d39feaf9debe42b681d75e532d7ed8f8 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:36.714852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.724990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da09fc-0bea-4aba-9f9f-90dd399b6665 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.729629 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3240136-127c-4393-87d4-0b5aa60ac376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.730662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240136-127c-4393-87d4-0b5aa60ac376 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.731129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240136-127c-4393-87d4-0b5aa60ac376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.731565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240136-127c-4393-87d4-0b5aa60ac376 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.732955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240136-127c-4393-87d4-0b5aa60ac376 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:36.735261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240136-127c-4393-87d4-0b5aa60ac376 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:36.742082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 110/213] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:36 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:36.743693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.754609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204307cc-77b5-4c1e-9e84-f22f1b106f2f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.759314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.760452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.761315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.761851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/d39feaf9debe42b681d75e532d7ed8f8/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.764082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b4d38393444778c0cb2025d06fc52, user_id=d39feaf9debe42b681d75e532d7ed8f8, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:36.766981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:36.771555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd3f-d6d0-4ed1-a538-41fdbe0fd800 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.771826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd3f-d6d0-4ed1-a538-41fdbe0fd800 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.772104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961bd3f-d6d0-4ed1-a538-41fdbe0fd800 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.773884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 111/214] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:36.780073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11ea8-6d0c-4f0c-8b2b-2b19ea0a1820 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.780360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11ea8-6d0c-4f0c-8b2b-2b19ea0a1820 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.780637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11ea8-6d0c-4f0c-8b2b-2b19ea0a1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.799229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-38d11ea8-6d0c-4f0c-8b2b-2b19ea0a1820 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:36.800464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-38d11ea8-6d0c-4f0c-8b2b-2b19ea0a1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:36.809337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 112/215] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:36.812308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701217ff-300d-4e1b-8375-f29a326c22b2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.812308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701217ff-300d-4e1b-8375-f29a326c22b2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.812308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701217ff-300d-4e1b-8375-f29a326c22b2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.814832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 113/216] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:36.817780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79fcf-2fae-4b6c-885b-8e79e52308c1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.818239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79fcf-2fae-4b6c-885b-8e79e52308c1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.818685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c79fcf-2fae-4b6c-885b-8e79e52308c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.836931 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 104/217] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:36 2022] PUT /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/d39feaf9debe42b681d75e532d7ed8f8/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:36.837416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-30c79fcf-2fae-4b6c-885b-8e79e52308c1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:36.841011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.841132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-30c79fcf-2fae-4b6c-885b-8e79e52308c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:36.913460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529d514-d44c-45f2-acbe-dc44e64b3cc0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.918095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.918974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.919256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.919532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.920566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 114/218] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:36.921755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8004b-53dc-4f31-873e-c8d0cc1c57c6 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.922038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8004b-53dc-4f31-873e-c8d0cc1c57c6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.922319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8004b-53dc-4f31-873e-c8d0cc1c57c6 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.926848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 115/219] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:36.934419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b8e8b-48d0-4cb7-8873-c8d9464c16a8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.935013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b8e8b-48d0-4cb7-8873-c8d9464c16a8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.935535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b8e8b-48d0-4cb7-8873-c8d9464c16a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.936868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:36.944429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:36.950772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 105/220] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:36.950772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.956923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146a094-e6ef-4a38-ba29-8e6a5e14dc5e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.958125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3e6b8e8b-48d0-4cb7-8873-c8d9464c16a8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:36.959507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3e6b8e8b-48d0-4cb7-8873-c8d9464c16a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:36.961421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.962216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.962496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.962770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.964081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:36.965796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:36.967457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 106/221] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:36.967457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.973480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 116/222] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:36.974164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b8e8b-48d0-4cb7-8873-c8d9464c16a8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:36.982742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89d5ca-6142-4693-baa7-4c7755387860 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.985783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b8e8b-48d0-4cb7-8873-c8d9464c16a8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:36.988136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.989219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.989772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.990247 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.990716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:36.991458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:36.991882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:36.992164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:36.992566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:36.992906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:36.993382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:36.995440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:36.996340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.006179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 107/223] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:37.007171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.021151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df3092-c9ad-4bf2-96f1-ad8b0e89a2a6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.025601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.026948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.027227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.027547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.038233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:37.045859 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:37.047107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 108/224] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:37.047958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.057712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e820ce-c7b2-4091-81c1-6b0d9482aaf1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.062025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.062842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.063123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.063393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] PATH_INFO: `/v3/users/d39feaf9debe42b681d75e532d7ed8f8` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.064614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] RBAC: Authorizing `identity:get_user(user_id=d39feaf9debe42b681d75e532d7ed8f8)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.066735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.068485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 109/225] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/users/d39feaf9debe42b681d75e532d7ed8f8 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:37.069160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.078969 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee277d8e-024d-4e77-8e99-663690a1536c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.083329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.084060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.084295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.084571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.085829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:37.086139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.087729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.098078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 110/226] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:37.098843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.108623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92336c56-6424-49d3-883e-15f909f3e2c7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.110921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 117/227] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:25:36 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:37.112548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.122170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.123272 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.123557 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.123830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.125242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.128593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.131047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 111/228] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:37.132812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2355a3-59ee-443f-a3f3-0f0f53df0265 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.137432 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.139490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.140656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.141151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.141634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] PATH_INFO: `/v3/users/1ddcf80c8aa44f73800eb9cceedea656` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.149743 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19279cbc-eaff-4b01-a4cc-b4c5fb47b1d2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.156171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c188e58-3eab-40fb-b22b-30a5202c5eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.157296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c188e58-3eab-40fb-b22b-30a5202c5eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.157574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c188e58-3eab-40fb-b22b-30a5202c5eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.157844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c188e58-3eab-40fb-b22b-30a5202c5eb3 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/d39feaf9debe42b681d75e532d7ed8f8/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.161125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c188e58-3eab-40fb-b22b-30a5202c5eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b4d38393444778c0cb2025d06fc52, user_id=d39feaf9debe42b681d75e532d7ed8f8, role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.161467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ddcf80c8aa44f73800eb9cceedea656)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.163868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c188e58-3eab-40fb-b22b-30a5202c5eb3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.164347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.167035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 118/229] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/users/1ddcf80c8aa44f73800eb9cceedea656 => generated 297 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:37.172590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.182953 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290b73e-102a-4a69-8beb-f2fc718ae0f3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.187693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.188361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.188640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.188915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.197740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.200089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.210080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 119/230] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:37.216217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.225344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75b19-9e81-4892-80b5-764ca3bebf77 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.229836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.230710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.231021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.231348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.232599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.234667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.236464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 120/231] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:37.241023 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 112/232] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:37 2022] PUT /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/d39feaf9debe42b681d75e532d7ed8f8/roles/8fce00171f5149e2b0de6dffe397598a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:25:37.246349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:37.256220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae7dca-e4a4-4f00-a311-ad16b99e2cca admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:37.321980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf92d26-b23a-4994-a98d-321b2e869c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:37.322563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf92d26-b23a-4994-a98d-321b2e869c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:37.322866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf92d26-b23a-4994-a98d-321b2e869c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:37.323693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf92d26-b23a-4994-a98d-321b2e869c55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:37.324565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf92d26-b23a-4994-a98d-321b2e869c55 admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=1ddcf80c8aa44f73800eb9cceedea656) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:37.324877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf92d26-b23a-4994-a98d-321b2e869c55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:37.326830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf92d26-b23a-4994-a98d-321b2e869c55 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:37.333963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 121/233] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:37 2022] GET /identity/v3/role_assignments?user.id=1ddcf80c8aa44f73800eb9cceedea656&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=9d58693d11544e18a74ccda41182d77e => generated 259 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:39.691805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770752-bd0b-47c4-87a2-e20fa0e2d761 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.692331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770752-bd0b-47c4-87a2-e20fa0e2d761 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.692331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e770752-bd0b-47c4-87a2-e20fa0e2d761 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.694109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 113/234] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:39.700372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285f98c-ea85-4df5-8dda-9d8f66f3e2d4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.700852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285f98c-ea85-4df5-8dda-9d8f66f3e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.700930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285f98c-ea85-4df5-8dda-9d8f66f3e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.727856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7285f98c-ea85-4df5-8dda-9d8f66f3e2d4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:39.729104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7285f98c-ea85-4df5-8dda-9d8f66f3e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:39.737257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 122/235] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:39.787500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e770752-bd0b-47c4-87a2-e20fa0e2d761 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:39.801330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e770752-bd0b-47c4-87a2-e20fa0e2d761 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:39.811035 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5729ce-73c1-4e37-9b45-5bc2bf30aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:39.811834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5729ce-73c1-4e37-9b45-5bc2bf30aae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.812113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5729ce-73c1-4e37-9b45-5bc2bf30aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.812385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5729ce-73c1-4e37-9b45-5bc2bf30aae9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.827728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5729ce-73c1-4e37-9b45-5bc2bf30aae9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:39.834523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-ae5729ce-73c1-4e37-9b45-5bc2bf30aae9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:39.835764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 114/236] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:39.842748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285f98c-ea85-4df5-8dda-9d8f66f3e2d4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:39.855861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285f98c-ea85-4df5-8dda-9d8f66f3e2d4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:39.863691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:39.864382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.864663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.864924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.865714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:39.866014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:39.867697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:39.882115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac05e-39f8-4961-98fc-01ffb54f9a7e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.882421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac05e-39f8-4961-98fc-01ffb54f9a7e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.882663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac05e-39f8-4961-98fc-01ffb54f9a7e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.883639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 123/237] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:39.884741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 115/238] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:39.889747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:39.890454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e240e-e853-45e1-a348-45c9cafaf665 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.890740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e240e-e853-45e1-a348-45c9cafaf665 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.891041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e240e-e853-45e1-a348-45c9cafaf665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.904502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29dea5-44d9-4969-82fd-9ec0a5caa0fd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:39.911316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e44e240e-e853-45e1-a348-45c9cafaf665 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:39.912827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e44e240e-e853-45e1-a348-45c9cafaf665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:39.915840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:39.916765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.917094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.917376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] PATH_INFO: `/v3/users/d39feaf9debe42b681d75e532d7ed8f8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.920969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] RBAC: Authorizing `identity:get_user(user_id=d39feaf9debe42b681d75e532d7ed8f8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:39.923135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:39.924762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 124/239] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:39 2022] GET /identity/v3/users/d39feaf9debe42b681d75e532d7ed8f8 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:39.928085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 116/240] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:39.933133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:39.943831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969fb59-e01c-4d0d-8385-cc14c8365eee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:39.953205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e240e-e853-45e1-a348-45c9cafaf665 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:39.962274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e240e-e853-45e1-a348-45c9cafaf665 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:39.964679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:39.965331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.965611 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.965880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.970585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:39.971411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:39.971689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:39.971959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:39.980808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:39.982573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:39.992771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 125/241] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:39.997514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:39.998475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.009791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:40.011645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 117/242] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:40.016728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37781d86-8fa8-4880-b42e-27809784dbff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.020676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.022684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.023555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.023833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.024104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.028471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.030571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.032300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 126/243] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:39 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:40.038355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.040298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17196ed8-022e-4728-a847-d447609351d4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.051274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f560c-bade-4f3f-98ea-389b534c977d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.053387 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b36bb8-a3d3-4d82-bfef-6c0c9b4fe1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.055600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36bb8-a3d3-4d82-bfef-6c0c9b4fe1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.056089 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36bb8-a3d3-4d82-bfef-6c0c9b4fe1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.057078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b36bb8-a3d3-4d82-bfef-6c0c9b4fe1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.058992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b36bb8-a3d3-4d82-bfef-6c0c9b4fe1a7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:40.059837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b36bb8-a3d3-4d82-bfef-6c0c9b4fe1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.061103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.062825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.063132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.063415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.063676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b36bb8-a3d3-4d82-bfef-6c0c9b4fe1a7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.064265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=d39feaf9debe42b681d75e532d7ed8f8) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:40.064575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.066666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.074429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 118/244] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.074914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 127/245] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/role_assignments?user.id=d39feaf9debe42b681d75e532d7ed8f8&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:40.076301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc548-c2dc-4b2e-81b2-ca73546458a9 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.076785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc548-c2dc-4b2e-81b2-ca73546458a9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.077271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc548-c2dc-4b2e-81b2-ca73546458a9 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.079470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 119/246] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:40.083671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.090906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e797-9548-4782-9216-3f89b9553bd3 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.091460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e797-9548-4782-9216-3f89b9553bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.092125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460e797-9548-4782-9216-3f89b9553bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.108498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100bce6-a35d-4efe-a44b-c6a4c12c8c8e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.113190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f1f47-297a-4678-9a49-0abcf594bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.114073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f1f47-297a-4678-9a49-0abcf594bf6b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.114355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f1f47-297a-4678-9a49-0abcf594bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.114636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f1f47-297a-4678-9a49-0abcf594bf6b admin admin] PATH_INFO: `/v3/users/d39feaf9debe42b681d75e532d7ed8f8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.115974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f1f47-297a-4678-9a49-0abcf594bf6b admin admin] RBAC: Authorizing `identity:get_user(user_id=d39feaf9debe42b681d75e532d7ed8f8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.118255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f1f47-297a-4678-9a49-0abcf594bf6b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.119384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-0460e797-9548-4782-9216-3f89b9553bd3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:40.120360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 128/247] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/users/d39feaf9debe42b681d75e532d7ed8f8 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.121665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8d57-c9bc-460f-bada-2c156d3cecd9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.121950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8d57-c9bc-460f-bada-2c156d3cecd9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.122239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b8d57-c9bc-460f-bada-2c156d3cecd9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.124257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 129/248] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:40.125008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0460e797-9548-4782-9216-3f89b9553bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:40.129016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b8d57-c9bc-460f-bada-2c156d3cecd9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.141160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 120/249] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:40.142599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125aca8-9c99-4996-976b-a6e9ca1c0d46 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.142906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125aca8-9c99-4996-976b-a6e9ca1c0d46 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.143182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125aca8-9c99-4996-976b-a6e9ca1c0d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.147930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b8d57-c9bc-460f-bada-2c156d3cecd9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.154137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5893f81-065d-4eaa-b2b7-737df10192cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.155203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893f81-065d-4eaa-b2b7-737df10192cc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.155690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893f81-065d-4eaa-b2b7-737df10192cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.156160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893f81-065d-4eaa-b2b7-737df10192cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.163581 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7125aca8-9c99-4996-976b-a6e9ca1c0d46 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:40.165114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7125aca8-9c99-4996-976b-a6e9ca1c0d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:40.165988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5893f81-065d-4eaa-b2b7-737df10192cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.168795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5893f81-065d-4eaa-b2b7-737df10192cc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.175687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 121/250] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:40.177104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad35eb-9a68-4f32-a9f5-378d8fc9ac7d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.177387 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad35eb-9a68-4f32-a9f5-378d8fc9ac7d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.177661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad35eb-9a68-4f32-a9f5-378d8fc9ac7d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.179633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 122/251] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:40.183240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 130/252] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:40.185132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad35eb-9a68-4f32-a9f5-378d8fc9ac7d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.186273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e74a7-cc5f-45c6-84c2-ebc41563a498 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.186882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e74a7-cc5f-45c6-84c2-ebc41563a498 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.187467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e74a7-cc5f-45c6-84c2-ebc41563a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.199170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad35eb-9a68-4f32-a9f5-378d8fc9ac7d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.203950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.204747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.205026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.205296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.208452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fb6e74a7-cc5f-45c6-84c2-ebc41563a498 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:40.209679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fb6e74a7-cc5f-45c6-84c2-ebc41563a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:40.217326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:40.217906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 131/253] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:40.218674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e74a7-cc5f-45c6-84c2-ebc41563a498 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.228140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e74a7-cc5f-45c6-84c2-ebc41563a498 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.232671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:40.233624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.234582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.234758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.235212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.235409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 123/254] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:40.236306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.236771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.238380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.244924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 132/255] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.244924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.250724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3753b-edda-4df3-ac68-4cdafecb43a1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.255800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.255928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8df290-3edf-4d71-8322-7c2d68ae30d7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.256584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.256863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.257130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.260301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.261513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.261793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.262066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.262849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:40.263153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.264727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.270908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:40.273762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 133/256] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.275630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.277954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:40.279201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 124/257] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:40.279967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.289620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323070-4cd2-416a-92b4-7d0a428572be admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.289783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e585-a6d8-49a4-829c-51ecd26255d2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.295090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.295856 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.296138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.296414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.296794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.297444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.297700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.297812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.297997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.298869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] RBAC: Adding query filter params (role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=d39feaf9debe42b681d75e532d7ed8f8) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:40.299187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.299423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.301008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.301270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 125/258] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.302030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.308028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 134/259] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/role_assignments?user.id=d39feaf9debe42b681d75e532d7ed8f8&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=8fce00171f5149e2b0de6dffe397598a => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.309764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.316315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ce7b-47c9-47c9-9225-0a5e7dae38dc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.321252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8dd28-0fbf-438b-9344-28fab9f4ddd4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.322089 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.323044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.328317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.328317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] PATH_INFO: `/v3/users/1ddcf80c8aa44f73800eb9cceedea656` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.328317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ddcf80c8aa44f73800eb9cceedea656)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.328596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.328596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.328596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.328596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.328872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.328938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:40.328938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.330036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 126/260] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/users/1ddcf80c8aa44f73800eb9cceedea656 => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.330206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.330617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.340883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 135/261] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.341751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.347491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1c747-3b87-4dc9-83c9-88df24bbad98 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.352227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.352540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532955c6-4f31-498f-bc82-cfc0a8ac0ffc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.352921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.353160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.353441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.354704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.357066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.359119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.360227 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.360719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.361205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.362693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.365153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.367484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 136/262] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.371005 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.380191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b196aa-07cf-4731-a11a-bef38b7f801e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.384950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.386249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.386653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.386959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] PATH_INFO: `/v3/users/8d8cc717827f4b8f9b3eb02d6604122d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.402988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8cc717827f4b8f9b3eb02d6604122d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.405164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.406948 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 137/263] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/users/8d8cc717827f4b8f9b3eb02d6604122d => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:40.407734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.422238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9617-9a1a-455d-9a55-4450ba732452 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.426608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.427537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.427814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.428082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/1ddcf80c8aa44f73800eb9cceedea656/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.430063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b4d38393444778c0cb2025d06fc52, user_id=1ddcf80c8aa44f73800eb9cceedea656, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.432958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.458925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 127/264] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:25:40 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:40.458925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.461066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab479c-2ee0-4ff5-9189-390992ca11f3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.467086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.467860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.468216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.468562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.477917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.481196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.492693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 128/265] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:40.498494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.508669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ccb97-e270-4779-aa93-9753a1d40b9c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.517552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 138/266] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:40 2022] PUT /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/1ddcf80c8aa44f73800eb9cceedea656/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:40.581493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277c947-445e-4f00-99a8-f67552683de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.582923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c947-445e-4f00-99a8-f67552683de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.583392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c947-445e-4f00-99a8-f67552683de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.584121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c947-445e-4f00-99a8-f67552683de4 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.586061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277c947-445e-4f00-99a8-f67552683de4 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.589379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277c947-445e-4f00-99a8-f67552683de4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.591825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 129/267] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:40.598096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:40.609595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caae9f-c2f8-485f-887d-d088a64b52bb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:40.614608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc140a8-c85f-4244-8527-81f56f12a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:40.615631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc140a8-c85f-4244-8527-81f56f12a17e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:40.616113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc140a8-c85f-4244-8527-81f56f12a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:40.616564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc140a8-c85f-4244-8527-81f56f12a17e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:40.617606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc140a8-c85f-4244-8527-81f56f12a17e admin admin] RBAC: Adding query filter params (role.id=952841af23ec49cb83f92fb44ffdbf17, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=8d8cc717827f4b8f9b3eb02d6604122d) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:40.618105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc140a8-c85f-4244-8527-81f56f12a17e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:40.620865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc140a8-c85f-4244-8527-81f56f12a17e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:40.627890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 139/268] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:40 2022] GET /identity/v3/role_assignments?user.id=8d8cc717827f4b8f9b3eb02d6604122d&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=952841af23ec49cb83f92fb44ffdbf17 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:42.768975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c958-f368-4f34-829c-8dfff9b32d3f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.769562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c958-f368-4f34-829c-8dfff9b32d3f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.769562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c958-f368-4f34-829c-8dfff9b32d3f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.771277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 130/269] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:42.776929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7436-bf32-49c1-b215-7ee1f2d1368b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.777396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7436-bf32-49c1-b215-7ee1f2d1368b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.777477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7436-bf32-49c1-b215-7ee1f2d1368b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.795466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-957c7436-bf32-49c1-b215-7ee1f2d1368b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:42.796633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-957c7436-bf32-49c1-b215-7ee1f2d1368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:42.804180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 140/270] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:42.828154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c958-f368-4f34-829c-8dfff9b32d3f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:42.841055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c958-f368-4f34-829c-8dfff9b32d3f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:42.845363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:42.846132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.846403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.846670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.857959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:42.864696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:42.870575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 131/271] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:42.872395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86add7-4995-4713-8efd-76fb1de84147 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.872989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86add7-4995-4713-8efd-76fb1de84147 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.873274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86add7-4995-4713-8efd-76fb1de84147 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.874210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:42.875183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 141/272] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:42.876164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471474ae-e0a8-4287-ad5c-3ced8805366f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.876448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471474ae-e0a8-4287-ad5c-3ced8805366f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.876715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471474ae-e0a8-4287-ad5c-3ced8805366f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.878638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 142/273] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:42.882078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c54c-e020-41e3-88b2-aaf782d93d81 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.882357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c54c-e020-41e3-88b2-aaf782d93d81 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.882628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c54c-e020-41e3-88b2-aaf782d93d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.884928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8e002-a724-4362-9f17-93a1e32b6f12 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:42.889422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61be1ea-ec15-4f59-ace8-84ebc5c31d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:42.890071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be1ea-ec15-4f59-ace8-84ebc5c31d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.890350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be1ea-ec15-4f59-ace8-84ebc5c31d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.890622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61be1ea-ec15-4f59-ace8-84ebc5c31d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.891410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be1ea-ec15-4f59-ace8-84ebc5c31d5c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:42.891865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be1ea-ec15-4f59-ace8-84ebc5c31d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:42.893485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61be1ea-ec15-4f59-ace8-84ebc5c31d5c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:42.900703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e960c54c-e020-41e3-88b2-aaf782d93d81 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:42.902696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 132/274] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:42.902836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e960c54c-e020-41e3-88b2-aaf782d93d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:42.904744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdd5e4-3961-455c-8ac5-8b269910d050 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.905030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdd5e4-3961-455c-8ac5-8b269910d050 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.905300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdd5e4-3961-455c-8ac5-8b269910d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.912273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 143/275] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:42.915673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960c54c-e020-41e3-88b2-aaf782d93d81 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:42.923939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-69fdd5e4-3961-455c-8ac5-8b269910d050 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:42.924781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960c54c-e020-41e3-88b2-aaf782d93d81 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:42.925114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-69fdd5e4-3961-455c-8ac5-8b269910d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:42.929041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9c8f9-478c-48c4-94b3-d9f987d20a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:42.929996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9c8f9-478c-48c4-94b3-d9f987d20a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.930279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9c8f9-478c-48c4-94b3-d9f987d20a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.930551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9c8f9-478c-48c4-94b3-d9f987d20a00 admin admin] PATH_INFO: `/v3/users/1ddcf80c8aa44f73800eb9cceedea656` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.931770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9c8f9-478c-48c4-94b3-d9f987d20a00 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ddcf80c8aa44f73800eb9cceedea656)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:42.934485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9c8f9-478c-48c4-94b3-d9f987d20a00 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:42.936154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 144/276] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:42 2022] GET /identity/v3/users/1ddcf80c8aa44f73800eb9cceedea656 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:42.937310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352edb9-6c73-4a55-84fa-00599b952108 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.937592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352edb9-6c73-4a55-84fa-00599b952108 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.937867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352edb9-6c73-4a55-84fa-00599b952108 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.938938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 133/277] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:42.939654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 145/278] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:42.940602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdd5e4-3961-455c-8ac5-8b269910d050 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:42.943647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352edb9-6c73-4a55-84fa-00599b952108 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:42.952908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdd5e4-3961-455c-8ac5-8b269910d050 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:42.956306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352edb9-6c73-4a55-84fa-00599b952108 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:42.957155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f17e-6a6f-4bda-a0be-0cee28f5de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:42.957925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f17e-6a6f-4bda-a0be-0cee28f5de3d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.958202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f17e-6a6f-4bda-a0be-0cee28f5de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.958469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f17e-6a6f-4bda-a0be-0cee28f5de3d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.960431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:42.961028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.961302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.961569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.968729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572f17e-6a6f-4bda-a0be-0cee28f5de3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:42.969492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:42.971250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:42.975661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-f572f17e-6a6f-4bda-a0be-0cee28f5de3d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:42.976815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 134/279] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:42.977944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460ae8-9790-4491-8ccc-3d5bc6114611 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.978315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460ae8-9790-4491-8ccc-3d5bc6114611 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.978494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32460ae8-9790-4491-8ccc-3d5bc6114611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.981247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 146/280] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:42.981915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:42.990762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0b273-6fbf-4c09-93f1-32cf5d9adb54 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:42.995583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:42.996317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:42.996590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:42.996854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:42.997326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-32460ae8-9790-4491-8ccc-3d5bc6114611 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:42.998509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-32460ae8-9790-4491-8ccc-3d5bc6114611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:43.005998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 135/281] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:43.007144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:43.007863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460ae8-9790-4491-8ccc-3d5bc6114611 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.014115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:43.018833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 147/282] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:43.018833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.019074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32460ae8-9790-4491-8ccc-3d5bc6114611 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.024181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.025000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.025431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.025739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382431f-bb2c-40ac-b4e6-9ebccbab0d7b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.026530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.027507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:43.027971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.029703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.030636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.031455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.031729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.031991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.033413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.035468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.037092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 148/283] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.037882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.039615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 136/284] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.040544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.047303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8dbf9-4988-4ff4-a58a-e99cda23b578 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.051453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.052056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.052331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.052599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.052977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d790e-ee87-4df4-9a7f-41f622650595 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.053328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:43.053621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.055209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.057256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.058000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.058279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.058552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.059751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.061412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.062973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 137/285] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.063995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 149/286] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.067747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.067912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.077264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db33c3f-2382-43b9-9d25-c93b47ab225d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.077644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a375f31-294c-48ca-abe1-4a51ab3efb36 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.082823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.083648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.084283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.084283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.084283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] PATH_INFO: `/v3/users/3bb787f8757749dc9399fa2f6fcd087b` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.084531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.084531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.084782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.085609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=1ddcf80c8aa44f73800eb9cceedea656) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:43.085917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.087794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.094740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 150/287] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/role_assignments?user.id=1ddcf80c8aa44f73800eb9cceedea656&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=9d58693d11544e18a74ccda41182d77e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.095440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.104957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fef7f-fff0-4098-9a08-3e6bf5c06281 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.109423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc30cd-e3de-4771-959b-be4292c8784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.110090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc30cd-e3de-4771-959b-be4292c8784f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.110366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc30cd-e3de-4771-959b-be4292c8784f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.110635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc30cd-e3de-4771-959b-be4292c8784f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.111400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc30cd-e3de-4771-959b-be4292c8784f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.112375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] RBAC: Authorizing `identity:get_user(user_id=3bb787f8757749dc9399fa2f6fcd087b)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.113361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc30cd-e3de-4771-959b-be4292c8784f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.114595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.121459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 138/288] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/users/3bb787f8757749dc9399fa2f6fcd087b => generated 293 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.121459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.131690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dc7fa-879c-477c-a913-6c0fbb2d550c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.137194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.144084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.144084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.144084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] PATH_INFO: `/v3/users/8d8cc717827f4b8f9b3eb02d6604122d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.144084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8cc717827f4b8f9b3eb02d6604122d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.144084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.144989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 139/289] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/users/8d8cc717827f4b8f9b3eb02d6604122d => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.145594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.156619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60b7c9-33b6-4fed-982a-99d77e7262d3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.161858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.162525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.162832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.163114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.163991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, user.id=3bb787f8757749dc9399fa2f6fcd087b, scope.system=all) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:43.164281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.166161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.187027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 140/290] 10.222.0.21 () {56 vars in 1329 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/role_assignments?user.id=3bb787f8757749dc9399fa2f6fcd087b&scope.system=all&role.id=9d58693d11544e18a74ccda41182d77e => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.187027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.197587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94a4c-eff9-44d9-bae0-8b0f6248c50b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.203088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.203996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.204278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.204553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.205918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.208217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.212953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 141/291] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:43 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:43.216905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:43.227439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959708-e8bc-48ce-b631-495775d10dbd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:43.232402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f28470-6c4a-407a-bb9a-9bdf602d7eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:43.233305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28470-6c4a-407a-bb9a-9bdf602d7eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:43.233582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28470-6c4a-407a-bb9a-9bdf602d7eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:43.233853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28470-6c4a-407a-bb9a-9bdf602d7eaf admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/8d8cc717827f4b8f9b3eb02d6604122d/roles/952841af23ec49cb83f92fb44ffdbf17` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:43.236066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f28470-6c4a-407a-bb9a-9bdf602d7eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b4d38393444778c0cb2025d06fc52, user_id=8d8cc717827f4b8f9b3eb02d6604122d, role_id=952841af23ec49cb83f92fb44ffdbf17)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:43.238913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f28470-6c4a-407a-bb9a-9bdf602d7eaf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:43.240451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 151/292] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:25:43 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:43.323718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 142/293] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:25:43 2022] PUT /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52/users/8d8cc717827f4b8f9b3eb02d6604122d/roles/952841af23ec49cb83f92fb44ffdbf17 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:25:45.425547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0da57-da16-4b4b-8647-23f00501700b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.426077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0da57-da16-4b4b-8647-23f00501700b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.426077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0da57-da16-4b4b-8647-23f00501700b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.427856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 152/294] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:45.434050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2665d-283e-4a04-915a-72ab2d963a90 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.434568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2665d-283e-4a04-915a-72ab2d963a90 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.434568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2665d-283e-4a04-915a-72ab2d963a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.454040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a8c2665d-283e-4a04-915a-72ab2d963a90 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:45.455254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a8c2665d-283e-4a04-915a-72ab2d963a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:45.514232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 143/295] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:45.536964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0da57-da16-4b4b-8647-23f00501700b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.549796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0da57-da16-4b4b-8647-23f00501700b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.554083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2d58b-225e-44ef-8223-0a3001fbc2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.554904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2d58b-225e-44ef-8223-0a3001fbc2ea admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.555184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2d58b-225e-44ef-8223-0a3001fbc2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.555452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2d58b-225e-44ef-8223-0a3001fbc2ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.567626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2d58b-225e-44ef-8223-0a3001fbc2ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:45.579497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a0d2d58b-225e-44ef-8223-0a3001fbc2ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:45.579497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 153/296] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:45.581729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2665d-283e-4a04-915a-72ab2d963a90 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.582254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617f57-b875-4c64-a9e3-e0f9e2697002 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.582537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617f57-b875-4c64-a9e3-e0f9e2697002 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.582836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617f57-b875-4c64-a9e3-e0f9e2697002 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.584802 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 154/297] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:45.589713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6627cdf-3581-412e-a9b8-027a344f000d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.589990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6627cdf-3581-412e-a9b8-027a344f000d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.590262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6627cdf-3581-412e-a9b8-027a344f000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.591841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2665d-283e-4a04-915a-72ab2d963a90 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.596561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.597220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.597501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.597774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.598536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:45.598860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.600457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.609395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f6627cdf-3581-412e-a9b8-027a344f000d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:45.609998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 144/298] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:45.611045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f6627cdf-3581-412e-a9b8-027a344f000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:45.615511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.622568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 155/299] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:45.628076 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a88a24-a487-4152-8741-0808a8def41e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.631285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.632129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.632410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.632682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] PATH_INFO: `/v3/users/3bb787f8757749dc9399fa2f6fcd087b` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.633885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] RBAC: Authorizing `identity:get_user(user_id=3bb787f8757749dc9399fa2f6fcd087b)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.636084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.637782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 145/300] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/users/3bb787f8757749dc9399fa2f6fcd087b => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:45.643173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6627cdf-3581-412e-a9b8-027a344f000d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.647614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.659758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6627cdf-3581-412e-a9b8-027a344f000d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.666310 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0c75-ac47-4610-8c87-7736343419db admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.669278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf5b57-e7da-4df5-bfaf-8b4e4cee6f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.671441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf5b57-e7da-4df5-bfaf-8b4e4cee6f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.672106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf5b57-e7da-4df5-bfaf-8b4e4cee6f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.672574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf5b57-e7da-4df5-bfaf-8b4e4cee6f53 admin admin] PATH_INFO: `/v3/system/users/3bb787f8757749dc9399fa2f6fcd087b/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.674129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74402c0-e6c3-48fb-9cf0-7edc88c65aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.675178 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf5b57-e7da-4df5-bfaf-8b4e4cee6f53 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3bb787f8757749dc9399fa2f6fcd087b, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.675380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74402c0-e6c3-48fb-9cf0-7edc88c65aee admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.675872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74402c0-e6c3-48fb-9cf0-7edc88c65aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.676251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74402c0-e6c3-48fb-9cf0-7edc88c65aee admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.676954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-ccdf5b57-e7da-4df5-bfaf-8b4e4cee6f53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:45.676954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:45.676954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:45.678484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf5b57-e7da-4df5-bfaf-8b4e4cee6f53 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.690644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74402c0-e6c3-48fb-9cf0-7edc88c65aee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:45.697413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-b74402c0-e6c3-48fb-9cf0-7edc88c65aee admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:45.698687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 146/301] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:45.700693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992411-75e2-42a1-82a4-0b0dfa4bfe05 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.700693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992411-75e2-42a1-82a4-0b0dfa4bfe05 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.700693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992411-75e2-42a1-82a4-0b0dfa4bfe05 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.702037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 147/302] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:45.703120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7b87-9611-4659-916a-89f43c2ccdc7 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.703400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7b87-9611-4659-916a-89f43c2ccdc7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.703669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7b87-9611-4659-916a-89f43c2ccdc7 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.705329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 148/303] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:45.705896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7b87-9611-4659-916a-89f43c2ccdc7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.718450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7b87-9611-4659-916a-89f43c2ccdc7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.722612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eff7c2-cb80-40a1-8d70-5ea4d6598e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.723219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eff7c2-cb80-40a1-8d70-5ea4d6598e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.723602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eff7c2-cb80-40a1-8d70-5ea4d6598e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.723754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eff7c2-cb80-40a1-8d70-5ea4d6598e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.724486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eff7c2-cb80-40a1-8d70-5ea4d6598e95 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:45.724785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eff7c2-cb80-40a1-8d70-5ea4d6598e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.726349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eff7c2-cb80-40a1-8d70-5ea4d6598e95 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.735157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 149/304] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:45.736266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6290c85-1112-42da-92e2-127f9d52f753 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.736545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6290c85-1112-42da-92e2-127f9d52f753 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.736814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6290c85-1112-42da-92e2-127f9d52f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.753047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 156/305] 10.222.0.21 () {58 vars in 1355 bytes} [Mon Jan 31 04:25:45 2022] PUT /identity/v3/system/users/3bb787f8757749dc9399fa2f6fcd087b/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:45.754296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f6290c85-1112-42da-92e2-127f9d52f753 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:45.754434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a87f5-08f3-44dc-be10-df6e7251f62c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.754614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a87f5-08f3-44dc-be10-df6e7251f62c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.754934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a87f5-08f3-44dc-be10-df6e7251f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.758269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f6290c85-1112-42da-92e2-127f9d52f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:45.770473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 150/306] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:45.770473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6290c85-1112-42da-92e2-127f9d52f753 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.780110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ad6a87f5-08f3-44dc-be10-df6e7251f62c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:45.781218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6290c85-1112-42da-92e2-127f9d52f753 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.781864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ad6a87f5-08f3-44dc-be10-df6e7251f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:45.786465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.787605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.787884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.788156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] PATH_INFO: `/v3/users/8d8cc717827f4b8f9b3eb02d6604122d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.789725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d8cc717827f4b8f9b3eb02d6604122d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.792485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 157/307] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:45.798890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.798890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 151/308] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/users/8d8cc717827f4b8f9b3eb02d6604122d => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:45.798890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.800153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a87f5-08f3-44dc-be10-df6e7251f62c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.810303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a87f5-08f3-44dc-be10-df6e7251f62c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.813483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b83f7-ed1a-4275-9cf9-41c22ab5d0c8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.815643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.816482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.816898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.817323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.818508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.819358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.819642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.819923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.821135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.822999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.824728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 152/309] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:45.825522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.828054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.830099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.837295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38ca9-5258-41d2-938e-9596b5321a25 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.841074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 158/310] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:45.842166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.847453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.848260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.848535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.848802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.852010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae9c17-e0c2-42a6-9e92-1733705c846d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.858251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.859050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.859335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.859615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] PATH_INFO: `/v3/groups` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.860331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.861377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:45.861377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:45.861377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:45.861717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:45.862616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.868765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:45.870611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 153/311] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:45.871226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.882231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ad544-1c4a-46fd-9fe1-323d0b10c54e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.887016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.887898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.888244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.888456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.889691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.891830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.893597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 154/312] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:45.899307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.910002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8709e-5a0e-4ffb-be38-9e8ec2e99b09 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.914458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.915183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.915461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.915765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.917119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:45.917424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.919362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.927613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 159/313] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Jan 31 04:25:45 2022] POST /identity/v3/groups => generated 229 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:45.928374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.929279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 155/314] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:45.935071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.939961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d533d7-5cbb-4549-8d57-22969abe462f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.945481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.946168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.946453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.946614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e44be-dafd-4bf2-8397-75ee06450dc6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.946711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.947720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] RBAC: Adding query filter params (role.id=952841af23ec49cb83f92fb44ffdbf17, scope.project.id=b98b4d38393444778c0cb2025d06fc52, user.id=8d8cc717827f4b8f9b3eb02d6604122d) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:45.948286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.950350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.951429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e0bf4-6bba-49ea-b19c-94eaa3d16b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.952372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e0bf4-6bba-49ea-b19c-94eaa3d16b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.952650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e0bf4-6bba-49ea-b19c-94eaa3d16b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.952925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e0bf4-6bba-49ea-b19c-94eaa3d16b7b admin admin] PATH_INFO: `/v3/users/8268ccb19d6d42bc89d043ceb070c112` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:45.964265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 160/315] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/role_assignments?user.id=8d8cc717827f4b8f9b3eb02d6604122d&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=952841af23ec49cb83f92fb44ffdbf17 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:45.971255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e0bf4-6bba-49ea-b19c-94eaa3d16b7b admin admin] RBAC: Authorizing `identity:get_user(user_id=8268ccb19d6d42bc89d043ceb070c112)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:45.973600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e0bf4-6bba-49ea-b19c-94eaa3d16b7b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:45.975502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 156/316] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/users/8268ccb19d6d42bc89d043ceb070c112 => generated 293 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:45.982395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:45.993217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfe369-1bca-4be7-ab5c-c2783ef41714 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:45.998528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3f4be-b9aa-4db5-a527-bd4a633f75bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:45.999235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3f4be-b9aa-4db5-a527-bd4a633f75bd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:45.999521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3f4be-b9aa-4db5-a527-bd4a633f75bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:45.999799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3f4be-b9aa-4db5-a527-bd4a633f75bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:46.000663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3f4be-b9aa-4db5-a527-bd4a633f75bd admin admin] RBAC: Adding query filter params (role.id=952841af23ec49cb83f92fb44ffdbf17, user.id=8268ccb19d6d42bc89d043ceb070c112, scope.system=all) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:46.000977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3f4be-b9aa-4db5-a527-bd4a633f75bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:46.002937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3f4be-b9aa-4db5-a527-bd4a633f75bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:46.011738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 161/317] 10.222.0.21 () {56 vars in 1329 bytes} [Mon Jan 31 04:25:45 2022] GET /identity/v3/role_assignments?user.id=8268ccb19d6d42bc89d043ceb070c112&scope.system=all&role.id=952841af23ec49cb83f92fb44ffdbf17 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:47.996475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d58d4-3874-4714-8b90-e0b073da7e6f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:47.997010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d58d4-3874-4714-8b90-e0b073da7e6f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:47.997010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d58d4-3874-4714-8b90-e0b073da7e6f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:47.999034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 157/318] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:48.004596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bb070-72c7-40a3-839b-ff1b6d9033da None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.005069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bb070-72c7-40a3-839b-ff1b6d9033da None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.005140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bb070-72c7-40a3-839b-ff1b6d9033da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.023428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d89bb070-72c7-40a3-839b-ff1b6d9033da None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:48.024612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d89bb070-72c7-40a3-839b-ff1b6d9033da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:48.032968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 162/319] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:48.056099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d58d4-3874-4714-8b90-e0b073da7e6f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.068345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d58d4-3874-4714-8b90-e0b073da7e6f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.072450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.073568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.073842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.074110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.090297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:48.097191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:48.098628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 158/320] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:48.104906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bb070-72c7-40a3-839b-ff1b6d9033da None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.114312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bb070-72c7-40a3-839b-ff1b6d9033da None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.118657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.119343 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.119812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.120109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.120870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:48.121174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.122777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.131149 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 163/321] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:48.136816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.146435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adc30a-9f84-4236-acbf-413842a072d8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.151231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61c2a1-f0a3-44dd-adb4-b076a5e566c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.152264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61c2a1-f0a3-44dd-adb4-b076a5e566c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.152623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61c2a1-f0a3-44dd-adb4-b076a5e566c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.152900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61c2a1-f0a3-44dd-adb4-b076a5e566c3 admin admin] PATH_INFO: `/v3/users/3bb787f8757749dc9399fa2f6fcd087b` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.154113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61c2a1-f0a3-44dd-adb4-b076a5e566c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3bb787f8757749dc9399fa2f6fcd087b)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.156245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61c2a1-f0a3-44dd-adb4-b076a5e566c3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.158214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 159/322] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/users/3bb787f8757749dc9399fa2f6fcd087b => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:48.163586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.173424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af45be4-ecb1-4518-89e2-040aab406a9a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.177718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ff447-a4ab-43aa-8e7b-0d81fc121db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.178355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ff447-a4ab-43aa-8e7b-0d81fc121db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.178636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ff447-a4ab-43aa-8e7b-0d81fc121db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.178938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ff447-a4ab-43aa-8e7b-0d81fc121db4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.179950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ff447-a4ab-43aa-8e7b-0d81fc121db4 admin admin] RBAC: Adding query filter params (role.id=9d58693d11544e18a74ccda41182d77e, user.id=3bb787f8757749dc9399fa2f6fcd087b, scope.system=all) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:48.180262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ff447-a4ab-43aa-8e7b-0d81fc121db4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.182716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ff447-a4ab-43aa-8e7b-0d81fc121db4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.192925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd53b49-8cab-4bbc-9d00-2f9e321fefdb None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.193209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd53b49-8cab-4bbc-9d00-2f9e321fefdb None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.193479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd53b49-8cab-4bbc-9d00-2f9e321fefdb None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.195376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 160/323] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:48.198916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 164/324] 10.222.0.21 () {56 vars in 1329 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/role_assignments?user.id=3bb787f8757749dc9399fa2f6fcd087b&scope.system=all&role.id=9d58693d11544e18a74ccda41182d77e => generated 510 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:48.201140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bd1dc-2693-4b14-884b-1f1f98f325b5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.201424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bd1dc-2693-4b14-884b-1f1f98f325b5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.201695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bd1dc-2693-4b14-884b-1f1f98f325b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.220998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-910bd1dc-2693-4b14-884b-1f1f98f325b5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:48.222216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-910bd1dc-2693-4b14-884b-1f1f98f325b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:48.227680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c096bf-5c9b-432d-8742-8d6c3b570ea9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.227972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c096bf-5c9b-432d-8742-8d6c3b570ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.228249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c096bf-5c9b-432d-8742-8d6c3b570ea9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.230753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 161/325] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:48.230907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 165/326] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:48.236445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b41d-e344-419f-915b-f4d46aa7d271 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.236744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b41d-e344-419f-915b-f4d46aa7d271 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.237003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b41d-e344-419f-915b-f4d46aa7d271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.254718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c096bf-5c9b-432d-8742-8d6c3b570ea9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.256661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c8a6b41d-e344-419f-915b-f4d46aa7d271 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:48.257847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c8a6b41d-e344-419f-915b-f4d46aa7d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:48.266663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 162/327] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:48.268188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c096bf-5c9b-432d-8742-8d6c3b570ea9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.272448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.273238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.273513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.273781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.274999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.276950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.278759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 166/328] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:48.284563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6b41d-e344-419f-915b-f4d46aa7d271 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.290610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.295218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6b41d-e344-419f-915b-f4d46aa7d271 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.300183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa003-cbea-4c24-9160-c1342aa6251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.300852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa003-cbea-4c24-9160-c1342aa6251f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.301127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa003-cbea-4c24-9160-c1342aa6251f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.301396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa003-cbea-4c24-9160-c1342aa6251f admin admin] PATH_INFO: `/v3/groups` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.302036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8adb94-501d-497b-8a21-3e86afda5b97 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.302133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa003-cbea-4c24-9160-c1342aa6251f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.303176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-982fa003-cbea-4c24-9160-c1342aa6251f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:48.303176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:48.303176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:48.304358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa003-cbea-4c24-9160-c1342aa6251f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.306485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.308159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.308437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.308708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.320677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:48.327698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:48.328944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 167/329] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:48.334753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.345153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95013fb2-62b3-4a97-a39f-9625e461dc6a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.349443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.350105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.350398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.350653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.351456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:48.351755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.353345 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.362868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 168/330] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:48.368564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.379095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c25913-b4a4-4392-a76c-f75fd2a84e86 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.383509 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.388479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.388479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.388479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] PATH_INFO: `/v3/users/8268ccb19d6d42bc89d043ceb070c112` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.388479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] RBAC: Authorizing `identity:get_user(user_id=8268ccb19d6d42bc89d043ceb070c112)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.388805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.390343 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 169/331] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:48 2022] GET /identity/v3/users/8268ccb19d6d42bc89d043ceb070c112 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:48.395875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:48.406061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c97f-5aff-487d-a908-ca17892cdbbc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:48.411404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46268c10-75f5-45a0-ae08-9656c4eb56a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:48.411896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268c10-75f5-45a0-ae08-9656c4eb56a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:48.412366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268c10-75f5-45a0-ae08-9656c4eb56a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:48.412579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268c10-75f5-45a0-ae08-9656c4eb56a4 admin admin] PATH_INFO: `/v3/system/users/8268ccb19d6d42bc89d043ceb070c112/roles/952841af23ec49cb83f92fb44ffdbf17` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:48.414052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46268c10-75f5-45a0-ae08-9656c4eb56a4 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8268ccb19d6d42bc89d043ceb070c112, role_id=952841af23ec49cb83f92fb44ffdbf17)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:48.417343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 163/332] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Jan 31 04:25:48 2022] POST /identity/v3/groups => generated 226 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:25:48.417600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46268c10-75f5-45a0-ae08-9656c4eb56a4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:48.496703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 170/333] 10.222.0.21 () {58 vars in 1355 bytes} [Mon Jan 31 04:25:48 2022] PUT /identity/v3/system/users/8268ccb19d6d42bc89d043ceb070c112/roles/952841af23ec49cb83f92fb44ffdbf17 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:25:50.840710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb82f-91e9-4a36-bc45-46eb92f0f57d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:50.841221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb82f-91e9-4a36-bc45-46eb92f0f57d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:50.841318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb82f-91e9-4a36-bc45-46eb92f0f57d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:50.843399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 164/334] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:50.848646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433f958-a5f3-4021-8de6-4c798f6adb56 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:50.849466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433f958-a5f3-4021-8de6-4c798f6adb56 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:50.849961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433f958-a5f3-4021-8de6-4c798f6adb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:50.873996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3433f958-a5f3-4021-8de6-4c798f6adb56 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:50.875543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3433f958-a5f3-4021-8de6-4c798f6adb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:50.887447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 171/335] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:50.918610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb82f-91e9-4a36-bc45-46eb92f0f57d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:50.937605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb82f-91e9-4a36-bc45-46eb92f0f57d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:50.945997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:50.946782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:50.947084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:50.947357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:50.964683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:50.971502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 31 04:25:50.973000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 165/336] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:50.978473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433f958-a5f3-4021-8de6-4c798f6adb56 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:50.991121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433f958-a5f3-4021-8de6-4c798f6adb56 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:50.999054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.000009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.000489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.000975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.001968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:51.002468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.004329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.019173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 172/337] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.024237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.038776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df92d-2fbd-45a4-9e93-7d0df5c2be64 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.046134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4163f-d028-418a-9df5-2bc1e6c58d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.047024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4163f-d028-418a-9df5-2bc1e6c58d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.047306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4163f-d028-418a-9df5-2bc1e6c58d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.047575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4163f-d028-418a-9df5-2bc1e6c58d5c admin admin] PATH_INFO: `/v3/users/8268ccb19d6d42bc89d043ceb070c112` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.048847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4163f-d028-418a-9df5-2bc1e6c58d5c admin admin] RBAC: Authorizing `identity:get_user(user_id=8268ccb19d6d42bc89d043ceb070c112)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.051078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4163f-d028-418a-9df5-2bc1e6c58d5c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.053050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 166/338] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/users/8268ccb19d6d42bc89d043ceb070c112 => generated 293 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.059370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.076300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32619327-c3c0-4067-ae93-d134d70dac4d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.090930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8fe44-4cb7-45de-ac54-f769650e7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.091541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8fe44-4cb7-45de-ac54-f769650e7f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.091971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8fe44-4cb7-45de-ac54-f769650e7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.092251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8fe44-4cb7-45de-ac54-f769650e7f1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.093113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8fe44-4cb7-45de-ac54-f769650e7f1c admin admin] RBAC: Adding query filter params (role.id=952841af23ec49cb83f92fb44ffdbf17, user.id=8268ccb19d6d42bc89d043ceb070c112, scope.system=all) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:51.093422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8fe44-4cb7-45de-ac54-f769650e7f1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.098826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8fe44-4cb7-45de-ac54-f769650e7f1c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.118530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 173/339] 10.222.0.21 () {56 vars in 1329 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/role_assignments?user.id=8268ccb19d6d42bc89d043ceb070c112&scope.system=all&role.id=952841af23ec49cb83f92fb44ffdbf17 => generated 510 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.541024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b920d-6784-4b26-8003-77415b5bead0 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.541913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b920d-6784-4b26-8003-77415b5bead0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.542389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b920d-6784-4b26-8003-77415b5bead0 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.544431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 167/340] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:51.549909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1615-4a58-4a88-8731-3dc3d5074f4b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.550195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1615-4a58-4a88-8731-3dc3d5074f4b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.550471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1615-4a58-4a88-8731-3dc3d5074f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.575964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d54e1615-4a58-4a88-8731-3dc3d5074f4b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:51.576927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0adf-1ffa-44e7-8f91-eca00be71809 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.577174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d54e1615-4a58-4a88-8731-3dc3d5074f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:51.577279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0adf-1ffa-44e7-8f91-eca00be71809 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.577475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0adf-1ffa-44e7-8f91-eca00be71809 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.579596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 168/341] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:51.585248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0039-a05c-4265-b0fc-901259d128aa None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.585522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0039-a05c-4265-b0fc-901259d128aa None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.585617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 174/342] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:51.585801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e0039-a05c-4265-b0fc-901259d128aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.611700 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1615-4a58-4a88-8731-3dc3d5074f4b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.612121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-903e0039-a05c-4265-b0fc-901259d128aa None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:51.613382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-903e0039-a05c-4265-b0fc-901259d128aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:51.623203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1615-4a58-4a88-8731-3dc3d5074f4b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.627672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 169/343] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:51.630576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.631404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.631682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.631955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.652538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:51.659614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0039-a05c-4265-b0fc-901259d128aa None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.664400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:51.665936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 175/344] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:51.670529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e0039-a05c-4265-b0fc-901259d128aa None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.672222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.685354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.686155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.686428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.686696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.692945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c3ec9-9830-43a3-be30-410f8182c246 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.706117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.706778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.707123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.707393 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.708162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:51.708461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.710050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.712946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:51.720828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:51.722052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 170/345] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:51.730616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 176/346] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:51.733008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.745858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36d5bf-a8ad-415c-bcbc-5cc996119e83 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.747799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.759930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.760659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.760940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.761209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.761973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:51.762273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.763895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.767028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ea41-85e0-48f8-81b2-c67d4d60c7f0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.779051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddabec1-9f88-416b-ada5-2f6a67dc0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.779700 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddabec1-9f88-416b-ada5-2f6a67dc0039 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.779980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddabec1-9f88-416b-ada5-2f6a67dc0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.780254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddabec1-9f88-416b-ada5-2f6a67dc0039 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.782917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 171/347] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.789470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.798296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddabec1-9f88-416b-ada5-2f6a67dc0039 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.800028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddabec1-9f88-416b-ada5-2f6a67dc0039 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.811507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf566a95-7eae-4f08-9f69-17f103e8bffd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.815394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 177/348] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:51.818895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655636b-b55d-404b-9503-08efb3cc892a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.819236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655636b-b55d-404b-9503-08efb3cc892a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.819521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655636b-b55d-404b-9503-08efb3cc892a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.821170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 178/349] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:51.824083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cf903-271a-4077-b07c-c2572c896c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.824456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655636b-b55d-404b-9503-08efb3cc892a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.824737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf903-271a-4077-b07c-c2572c896c83 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.825042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf903-271a-4077-b07c-c2572c896c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.825318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf903-271a-4077-b07c-c2572c896c83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.835002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cf903-271a-4077-b07c-c2572c896c83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.836775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cf903-271a-4077-b07c-c2572c896c83 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.847541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 172/350] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:51.848853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ebcb-fa21-4832-b4af-59b3b21a1484 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.849143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ebcb-fa21-4832-b4af-59b3b21a1484 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.849419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ebcb-fa21-4832-b4af-59b3b21a1484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.850092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655636b-b55d-404b-9503-08efb3cc892a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.861863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.862717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.863037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.863315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.864522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.867336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.869799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 179/351] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.871624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c105ebcb-fa21-4832-b4af-59b3b21a1484 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:51.872918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c105ebcb-fa21-4832-b4af-59b3b21a1484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:51.875032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.887057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 173/352] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:51.887572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd3f4e-bc2b-419d-9168-17371a0435d7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.887885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ebcb-fa21-4832-b4af-59b3b21a1484 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.893892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.894853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.895190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.895460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.896876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.899023 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ebcb-fa21-4832-b4af-59b3b21a1484 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.899195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.902003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 180/353] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.907018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.916558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.917517 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.917799 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.918080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.923012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37672-9e0d-42b4-bfee-488f1f46467a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.924754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.925916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:51.925916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:25:51.925916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:25:51.927148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.929131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 174/354] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.930000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.935559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.936426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.936705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.936980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.938373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.939505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:25:51.939505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:25:51.939505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:25:51.940690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.942297 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 181/355] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:51.942725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a79b4-661a-483a-9445-52f852f831d1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.944486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.956543 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.957402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.957781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.957951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807370-7f7a-4eb7-bb1b-7a4fdc7ed756 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.958103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.970101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:51.971128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:51.971618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:51.972093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:51.972962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:51.973351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=b98b4d38393444778c0cb2025d06fc52) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:51.973875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:51.975984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:51.981938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:51.982935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 182/356] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=9d58693d11544e18a74ccda41182d77e => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:51.983309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 175/357] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:51.983936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:51.995704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67828ab-c009-41cd-8319-29ca09824a39 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:51.997117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:52.001014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:52.001679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.001960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.002284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.006832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=0d7b577b01e44156a30ea00705ebb430) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:52.006832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:52.006832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:52.013476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 176/358] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=9d58693d11544e18a74ccda41182d77e => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:52.022741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fbabb-33d7-49ad-a7a9-59571c3a6049 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:52.034736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:52.035836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.036340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.036835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.037838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:52.038360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:52.044542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:52.061072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 183/359] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:52.067104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:52.081977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f7f03-1bdf-45f9-aba9-50fe5a307aa4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:52.094754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:52.095445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.095730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.096007 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.110526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:52.112421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:52.123490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 177/360] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:52.128744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:52.146155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0d78-6fd6-414a-9217-a581752af5cb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:52.153862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:52.154741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.155054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.155328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.156985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:52.159446 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:52.161672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 184/361] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:52 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:52.168109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:52.177606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c601b-6942-4de0-a645-d46d58bdf305 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:52.191325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef8082-01e8-4ff5-8909-acb9d88614fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:52.192203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef8082-01e8-4ff5-8909-acb9d88614fd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.192488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef8082-01e8-4ff5-8909-acb9d88614fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.192764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef8082-01e8-4ff5-8909-acb9d88614fd admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.194041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef8082-01e8-4ff5-8909-acb9d88614fd admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:52.195986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef8082-01e8-4ff5-8909-acb9d88614fd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:52.198167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 178/362] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:52 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:52.205361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:52.217730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b182fc-46ad-479f-9db4-f4b2d649418d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:52.227838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c22c3-e394-4b9a-8cc3-18b4a22b3ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:52.228512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c22c3-e394-4b9a-8cc3-18b4a22b3ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.229367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c22c3-e394-4b9a-8cc3-18b4a22b3ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.229773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c22c3-e394-4b9a-8cc3-18b4a22b3ba8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.231035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c22c3-e394-4b9a-8cc3-18b4a22b3ba8 admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=0d7b577b01e44156a30ea00705ebb430) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:52.231350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c22c3-e394-4b9a-8cc3-18b4a22b3ba8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:52.233464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c22c3-e394-4b9a-8cc3-18b4a22b3ba8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:52.243644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 185/363] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:52 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=8fce00171f5149e2b0de6dffe397598a => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:52.914888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8570-e4b6-430e-a2b8-4df2f3e8a724 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.915913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8570-e4b6-430e-a2b8-4df2f3e8a724 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.916452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8570-e4b6-430e-a2b8-4df2f3e8a724 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.918627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 179/364] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:52.924267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b0400-7890-433c-b307-565fbd394969 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.925085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b0400-7890-433c-b307-565fbd394969 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.925571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b0400-7890-433c-b307-565fbd394969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.945391 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e67b0400-7890-433c-b307-565fbd394969 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:52.946931 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e67b0400-7890-433c-b307-565fbd394969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:52.955836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 186/365] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:52.979011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d468ac-38d0-4415-a07d-0e3646f195a4 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.979645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d468ac-38d0-4415-a07d-0e3646f195a4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.980129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d468ac-38d0-4415-a07d-0e3646f195a4 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.982083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 180/366] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:52.990184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808ace-3a89-4deb-b18c-deb5291477d1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:52.990693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808ace-3a89-4deb-b18c-deb5291477d1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:52.991212 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808ace-3a89-4deb-b18c-deb5291477d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:52.993838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b0400-7890-433c-b307-565fbd394969 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.015480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b0400-7890-433c-b307-565fbd394969 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.022617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9e808ace-3a89-4deb-b18c-deb5291477d1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:53.024330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9e808ace-3a89-4deb-b18c-deb5291477d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:53.028832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.029959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.030436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.031878 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.046647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 181/367] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:53.050514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:53.057696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:53.059388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 187/368] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:53.067814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e808ace-3a89-4deb-b18c-deb5291477d1 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.078189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e808ace-3a89-4deb-b18c-deb5291477d1 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.084622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.093217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.094128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.094597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.096052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.097009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:53.099092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.104762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69532ea-a574-44a5-9fc7-548e46fad9bc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.105402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.118273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.119449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.119955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.120417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.122413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 182/369] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:53.128172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.136859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:53.144730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:53.146590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 188/370] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:53.152788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.153686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143564-7845-4955-99d9-353875381c9f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.163837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed7e68-890b-4c6d-b4d2-3509743ffb1b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.168798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.168923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.169459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.169737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.171864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.172472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.172965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.173442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.174403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:53.174925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.176719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.185268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.189758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.190350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 189/371] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:53.195905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.198395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 183/372] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:53.203506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.213245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040670f-0d81-4a04-909a-e7577a937be4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.213755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a46705-0203-4136-9efa-b22170beccbb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.219032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.219724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.220013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.220444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.220838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.220945 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.221296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.221661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.223117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.230834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.230834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 184/373] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:53.232461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.239535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.241618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.245020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c0699-d174-4966-b19f-76ba05f0f30a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.255521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.256422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.257943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.258240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] PATH_INFO: `/v3/groups/a1144a3f7b6841ba9f6f29656d483079` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.261401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 190/374] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:25:53.267938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.272258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] RBAC: Authorizing `identity:get_group(group_id=a1144a3f7b6841ba9f6f29656d483079)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.274233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.280544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 185/375] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/groups/a1144a3f7b6841ba9f6f29656d483079 => generated 229 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:53.286338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f2033-22ae-4f30-83b4-55c0a93494f1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.291266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.292144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.292415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.292741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.294252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.296495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.298561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 191/376] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:53.300963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.311677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b9cb-a5cd-4abf-ad1f-57da9b5b2961 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.312909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.325278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.325982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.326266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.326536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.327461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] RBAC: Adding query filter params (group.id=a1144a3f7b6841ba9f6f29656d483079, role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=6434f6a5574340a59ffe3c6ae995c685) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:53.327768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.331962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993e16f-57ef-427b-bfcd-65d31e74b3c9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.332895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.342349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb62c6-d56d-4ef2-bb73-228347122b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.343963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb62c6-d56d-4ef2-bb73-228347122b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.344240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb62c6-d56d-4ef2-bb73-228347122b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.345259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 186/377] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/role_assignments?group.id=a1144a3f7b6841ba9f6f29656d483079&scope.project.id=6434f6a5574340a59ffe3c6ae995c685&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:53.345454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb62c6-d56d-4ef2-bb73-228347122b48 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.351979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb62c6-d56d-4ef2-bb73-228347122b48 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.354755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb62c6-d56d-4ef2-bb73-228347122b48 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.356929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 192/378] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:53.362970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:53.375038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8ca7-600f-4363-8ebd-81e3dbd2765d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:53.380321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7526deb-fcda-42e1-aae7-1b6c5d34a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:53.380966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7526deb-fcda-42e1-aae7-1b6c5d34a9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:53.381299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7526deb-fcda-42e1-aae7-1b6c5d34a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:53.381575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7526deb-fcda-42e1-aae7-1b6c5d34a9eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:53.382493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7526deb-fcda-42e1-aae7-1b6c5d34a9eb admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=b98b4d38393444778c0cb2025d06fc52) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:53.382851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7526deb-fcda-42e1-aae7-1b6c5d34a9eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:53.384775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7526deb-fcda-42e1-aae7-1b6c5d34a9eb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:53.395728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 187/379] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:53 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=8fce00171f5149e2b0de6dffe397598a => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:54.997355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c162dc9-e288-477a-8181-a848c6ea4555 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:54.998047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c162dc9-e288-477a-8181-a848c6ea4555 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:54.998047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c162dc9-e288-477a-8181-a848c6ea4555 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.000170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 193/380] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:55.005025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03af96-5b6d-4861-8d31-9e529c5fe232 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.005522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03af96-5b6d-4861-8d31-9e529c5fe232 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.005670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03af96-5b6d-4861-8d31-9e529c5fe232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.015922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825c37-e878-4500-883f-9cd9dab810ea None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.016521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825c37-e878-4500-883f-9cd9dab810ea None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.016996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825c37-e878-4500-883f-9cd9dab810ea None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.019205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 194/381] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:55.024709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2d81-779b-4b00-9f39-1b0de7131764 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.025254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2d81-779b-4b00-9f39-1b0de7131764 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.026622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2d81-779b-4b00-9f39-1b0de7131764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.030589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7c03af96-5b6d-4861-8d31-9e529c5fe232 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:55.031811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7c03af96-5b6d-4861-8d31-9e529c5fe232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:55.051363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 188/382] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:55.052399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-787e2d81-779b-4b00-9f39-1b0de7131764 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:55.053613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-787e2d81-779b-4b00-9f39-1b0de7131764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:55.066769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 195/383] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:55.075298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03af96-5b6d-4861-8d31-9e529c5fe232 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.084844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03af96-5b6d-4861-8d31-9e529c5fe232 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.095038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.095836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.096116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.096391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.110930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:55.117832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:55.119416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 189/384] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:55.124225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2d81-779b-4b00-9f39-1b0de7131764 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.125399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.136252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d002342-6e5f-4964-9e8a-a2620d0f160c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.139633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2d81-779b-4b00-9f39-1b0de7131764 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.145215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.145893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.146174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.146445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.147258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:55.147562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.149182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.154434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.155253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.155531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.155801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.163767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 190/385] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:55.169525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.177876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:55.179006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c058-f03d-41e3-b15c-7712d0bbf8c1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.184996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:55.186899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.187747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.188027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.188303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.190206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.190736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 196/386] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:55.192165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.192269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.194044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 191/387] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:55.204309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.214758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31bf3b-ca64-4b64-bffe-64f451ec3210 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.219297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23671e-40cd-483b-b378-cbf48379f327 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.224150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.224810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.225092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.225368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.226133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:55.226437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.228069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.234380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c23f4-19f4-4ec8-857c-6ce88f277801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.235268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c23f4-19f4-4ec8-857c-6ce88f277801 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.235543 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c23f4-19f4-4ec8-857c-6ce88f277801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.235813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c23f4-19f4-4ec8-857c-6ce88f277801 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.237042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c23f4-19f4-4ec8-857c-6ce88f277801 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.239152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c23f4-19f4-4ec8-857c-6ce88f277801 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.241126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 192/389] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:55.241237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 197/389] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:55.242339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684810-2e22-47c0-9351-9876ec333c4c None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.242622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684810-2e22-47c0-9351-9876ec333c4c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.246155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.249643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684810-2e22-47c0-9351-9876ec333c4c None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.251426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 193/390] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:55.252146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684810-2e22-47c0-9351-9876ec333c4c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.259279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0be95-dcdd-4a55-916e-f45e8708a19e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.265041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a91cd2-ddbd-441e-8c3c-595267801eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.265876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a91cd2-ddbd-441e-8c3c-595267801eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.266157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a91cd2-ddbd-441e-8c3c-595267801eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.266516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a91cd2-ddbd-441e-8c3c-595267801eb8 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.267922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a91cd2-ddbd-441e-8c3c-595267801eb8 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.268082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684810-2e22-47c0-9351-9876ec333c4c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.269833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a91cd2-ddbd-441e-8c3c-595267801eb8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.271797 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 198/391] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:55.273016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc371fc-393a-4926-b8dc-e3efd6481497 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.273301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc371fc-393a-4926-b8dc-e3efd6481497 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.273573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc371fc-393a-4926-b8dc-e3efd6481497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.279964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.280870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.281108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.281374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52/groups/2b5305a19d9c41cbb45289a68427e11a/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.283612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b4d38393444778c0cb2025d06fc52, group_id=2b5305a19d9c41cbb45289a68427e11a, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.286243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.296088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9dc371fc-393a-4926-b8dc-e3efd6481497 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:55.297503 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9dc371fc-393a-4926-b8dc-e3efd6481497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:55.307291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 199/392] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:55.308399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc371fc-393a-4926-b8dc-e3efd6481497 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.327535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc371fc-393a-4926-b8dc-e3efd6481497 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.327535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.327535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.327535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.327850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.327850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.328862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.330753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 200/393] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:55.336367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.346412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b7c1b-0ffe-4efc-8c01-6ce657fd58f4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.351397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.352560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.353076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.354171 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430/groups/2b5305a19d9c41cbb45289a68427e11a/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.356641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b577b01e44156a30ea00705ebb430, group_id=2b5305a19d9c41cbb45289a68427e11a, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.359618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.385608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 194/394] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Jan 31 04:25:55 2022] PUT /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52/groups/2b5305a19d9c41cbb45289a68427e11a/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:55.386903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.455650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 201/395] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Jan 31 04:25:55 2022] PUT /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430/groups/2b5305a19d9c41cbb45289a68427e11a/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:55.472644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cdeb1-5872-43f8-b4a8-0a90ed0063fa admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.540274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.542216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.542953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.543412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.556264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:55.564578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:55.566145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 195/396] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:55.572680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.584085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31281cf-63ab-4ea2-a059-bd51034dd93b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.590219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.591358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.591909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.592362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.593378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:55.593882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.595757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.606304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 202/397] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:55.612073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.623611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120fe3d-3f42-4cc3-bd2f-d098321a4ab2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.628824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.629994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.630458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.630978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.632652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.635304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.637411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 196/398] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:55.643446 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.656638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4bbb0-6a5e-48b8-aea4-2979f3718c70 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.662985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d93d8-6398-40a2-bd98-7e2c35aecc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.664259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d93d8-6398-40a2-bd98-7e2c35aecc67 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.664775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d93d8-6398-40a2-bd98-7e2c35aecc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.665228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d93d8-6398-40a2-bd98-7e2c35aecc67 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.666834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d93d8-6398-40a2-bd98-7e2c35aecc67 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.669238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d93d8-6398-40a2-bd98-7e2c35aecc67 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.671814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 203/399] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:55 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:55.680489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:55.692495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684164-e1b6-413a-9f57-963ee0717b21 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:55.699003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e0180-6fa2-4eb6-b0ca-99297bdebe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:55.699949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e0180-6fa2-4eb6-b0ca-99297bdebe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:55.700228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e0180-6fa2-4eb6-b0ca-99297bdebe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:55.700609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e0180-6fa2-4eb6-b0ca-99297bdebe4a admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430/groups/2b5305a19d9c41cbb45289a68427e11a/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:55.703981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e0180-6fa2-4eb6-b0ca-99297bdebe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7b577b01e44156a30ea00705ebb430, group_id=2b5305a19d9c41cbb45289a68427e11a, role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:55.706764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e0180-6fa2-4eb6-b0ca-99297bdebe4a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:55.830977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 197/400] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Jan 31 04:25:55 2022] PUT /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430/groups/2b5305a19d9c41cbb45289a68427e11a/roles/8fce00171f5149e2b0de6dffe397598a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:56.226054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf4706-64d1-4fd6-8cda-3cadfb0ddff3 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.226588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf4706-64d1-4fd6-8cda-3cadfb0ddff3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.226588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf4706-64d1-4fd6-8cda-3cadfb0ddff3 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.228849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 204/401] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:56.235178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7064-a5ff-4cbd-b652-80a482301127 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.235678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7064-a5ff-4cbd-b652-80a482301127 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.235752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7064-a5ff-4cbd-b652-80a482301127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.255403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-eb1f7064-a5ff-4cbd-b652-80a482301127 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:56.256625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-eb1f7064-a5ff-4cbd-b652-80a482301127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:56.321546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 198/402] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:56.360478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf4706-64d1-4fd6-8cda-3cadfb0ddff3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.376724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf4706-64d1-4fd6-8cda-3cadfb0ddff3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.382708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.383567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.383845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.384110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.403777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:56.410911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:56.412649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 205/403] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:56.418550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7064-a5ff-4cbd-b652-80a482301127 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.432555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7064-a5ff-4cbd-b652-80a482301127 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.439032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.439998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.440504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.440984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.441944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:56.442445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.444275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.457684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 199/404] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:56.463513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.480171 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06898-84ab-42aa-9146-eeaf539b407e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.486445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.487365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.487641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.487911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] PATH_INFO: `/v3/groups/a1144a3f7b6841ba9f6f29656d483079` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.490175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] RBAC: Authorizing `identity:get_group(group_id=a1144a3f7b6841ba9f6f29656d483079)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.492352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.494582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 206/405] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/groups/a1144a3f7b6841ba9f6f29656d483079 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:56.500086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.515955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a7f28-0f3b-471f-b5e5-93cfb99cceff admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.527764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8821-9a63-4eff-9a1c-40137c135747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.528937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8821-9a63-4eff-9a1c-40137c135747 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.529420 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8821-9a63-4eff-9a1c-40137c135747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.529936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8821-9a63-4eff-9a1c-40137c135747 admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.535617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8821-9a63-4eff-9a1c-40137c135747 admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.537689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8821-9a63-4eff-9a1c-40137c135747 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.539899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 200/406] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:56.545674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.558601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c67d7b-6f26-474c-ad5f-b04ca3327f4f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.567284 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.568205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.568425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84433d-93ed-4eff-92b5-332dd97ef188 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.568526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.568785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685/groups/a1144a3f7b6841ba9f6f29656d483079/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.569207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84433d-93ed-4eff-92b5-332dd97ef188 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.569673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84433d-93ed-4eff-92b5-332dd97ef188 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.571895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 201/407] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:56.573203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6434f6a5574340a59ffe3c6ae995c685, group_id=a1144a3f7b6841ba9f6f29656d483079, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.578437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.578541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf318-e5ad-4e01-984c-587345133aa2 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.578541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf318-e5ad-4e01-984c-587345133aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.578541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf318-e5ad-4e01-984c-587345133aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.603048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-579cf318-e5ad-4e01-984c-587345133aa2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:56.605321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-579cf318-e5ad-4e01-984c-587345133aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:56.614325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 202/408] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:56.637830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf318-e5ad-4e01-984c-587345133aa2 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.647800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf318-e5ad-4e01-984c-587345133aa2 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.659485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 207/409] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Jan 31 04:25:56 2022] PUT /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685/groups/a1144a3f7b6841ba9f6f29656d483079/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:56.662166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.663450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.664028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.664461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.678408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:56.686834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:56.688360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 203/410] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:25:56.694576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.773843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e272d8-a4f4-4438-be53-a152710d0c34 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.780471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.781157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.781439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.781713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.782751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:56.783087 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.784712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.797607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 208/411] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:56.803409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.814513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312605b-f92d-4ea2-b873-7867b450094b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.819358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.820263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.820543 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.820878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.822763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.824891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.830942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 204/412] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:56.832819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.843614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442655a-3703-4135-9ace-f7935b35e04c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.848631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d2969-81a6-44f4-8d67-653959eee59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.850445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d2969-81a6-44f4-8d67-653959eee59a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.850445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d2969-81a6-44f4-8d67-653959eee59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.850445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d2969-81a6-44f4-8d67-653959eee59a admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.851653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d2969-81a6-44f4-8d67-653959eee59a admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.854483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d2969-81a6-44f4-8d67-653959eee59a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.860661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 209/413] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:56 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:56.862656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:56.875010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8804b46-2135-4896-aaa2-a288161a2f0a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:56.879569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe77c-bbef-42a3-bfbe-cfd245c666cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:56.880483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe77c-bbef-42a3-bfbe-cfd245c666cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:56.880760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe77c-bbef-42a3-bfbe-cfd245c666cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:56.881085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe77c-bbef-42a3-bfbe-cfd245c666cc admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52/groups/2b5305a19d9c41cbb45289a68427e11a/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:56.886123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe77c-bbef-42a3-bfbe-cfd245c666cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b4d38393444778c0cb2025d06fc52, group_id=2b5305a19d9c41cbb45289a68427e11a, role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:56.888979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe77c-bbef-42a3-bfbe-cfd245c666cc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:56.969553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 205/414] 10.222.0.21 () {58 vars in 1463 bytes} [Mon Jan 31 04:25:56 2022] PUT /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52/groups/2b5305a19d9c41cbb45289a68427e11a/roles/8fce00171f5149e2b0de6dffe397598a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:25:58.159203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd887-9a37-4c48-8a94-9db5910618dc None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.160139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd887-9a37-4c48-8a94-9db5910618dc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.160603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd887-9a37-4c48-8a94-9db5910618dc None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.162850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 210/415] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:58.168689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e15ac-86d2-44a3-a65a-b0f50ac02f65 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.169104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e15ac-86d2-44a3-a65a-b0f50ac02f65 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.169289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e15ac-86d2-44a3-a65a-b0f50ac02f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.195749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f45e15ac-86d2-44a3-a65a-b0f50ac02f65 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:58.196945 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f45e15ac-86d2-44a3-a65a-b0f50ac02f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:58.269433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 206/416] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:58.309994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd887-9a37-4c48-8a94-9db5910618dc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.332671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd887-9a37-4c48-8a94-9db5910618dc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.343155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25225052-c67d-40a1-b24c-cda2452e589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.344236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225052-c67d-40a1-b24c-cda2452e589d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.344709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225052-c67d-40a1-b24c-cda2452e589d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.345168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225052-c67d-40a1-b24c-cda2452e589d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.362139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25225052-c67d-40a1-b24c-cda2452e589d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:58.369589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-25225052-c67d-40a1-b24c-cda2452e589d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:58.371080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 211/417] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:58.376824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e15ac-86d2-44a3-a65a-b0f50ac02f65 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.382202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374086b-640e-4d0d-bd11-fb8668eeb61f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.382739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374086b-640e-4d0d-bd11-fb8668eeb61f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.383232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374086b-640e-4d0d-bd11-fb8668eeb61f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.386124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 212/418] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:25:58.391100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fa1db-87fe-458d-9c42-652a712737fe None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.391332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e15ac-86d2-44a3-a65a-b0f50ac02f65 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.391975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fa1db-87fe-458d-9c42-652a712737fe None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.392441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fa1db-87fe-458d-9c42-652a712737fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.399939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.400683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.401236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.401584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.402370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:58.402708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.408915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.417784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-141fa1db-87fe-458d-9c42-652a712737fe None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:58.419025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-141fa1db-87fe-458d-9c42-652a712737fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:58.423885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 207/419] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:58.429707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.439770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 213/420] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:25:58.448180 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97014-c666-4971-9564-a422ee677fc9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.455418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.456111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.456449 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.456722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.465802 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fa1db-87fe-458d-9c42-652a712737fe None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.467195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.470003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.483004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fa1db-87fe-458d-9c42-652a712737fe None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.483676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 208/421] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:58.490864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.499242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.500427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.500965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.501428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.504777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c19de7-679d-443c-ada0-088844eb8e62 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.516414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.517496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.517947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.518367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.521841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.524084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.531603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:58.539113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 31 04:25:58.539437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 209/422] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:58.541070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 214/423] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:58.542496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.551385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.553830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890657d7-6881-44d1-881c-bf203449ca9c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.567766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0e267-808e-4dd5-8897-285a3a4ff2a7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.569106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.570147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.570573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.575918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.575918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.575918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.577252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 210/424] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:58.581023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.582017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.582513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.582871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.583286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.584340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:58.584854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.586887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.595449 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe1957-8b68-4d3d-862d-ebb0ccc0df40 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.598325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 215/425] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:58.605308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.611201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.611867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.612149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.612425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.613297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=b98b4d38393444778c0cb2025d06fc52) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:58.613578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.615463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.617485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b05db-45c6-4fcc-b35e-88249cdca82a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.624694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 211/426] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=9d58693d11544e18a74ccda41182d77e => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:58.628132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.629074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.629555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.630040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.648089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.650816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.661717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 216/427] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:58.668032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.680663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2a6ac-e4c5-4810-851b-4369cad0cae0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.698414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.699333 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.699613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.699887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.703608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.705683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.707760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 212/428] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:58.713337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.723293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773d7a4-83f6-40f1-bf19-c174c754e1f1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.733586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aa035-71a4-46f4-8855-931dbce8778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.734866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa035-71a4-46f4-8855-931dbce8778a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.735363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa035-71a4-46f4-8855-931dbce8778a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.735830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aa035-71a4-46f4-8855-931dbce8778a admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.743784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aa035-71a4-46f4-8855-931dbce8778a admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.746900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aa035-71a4-46f4-8855-931dbce8778a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.749260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 217/429] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:58.755450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:58.772763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bcc8e-12f9-443b-a9c0-994c0fcfc3ab admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:58.783720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10b4bd-8ea5-461e-8821-e69b4eece46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:58.784393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10b4bd-8ea5-461e-8821-e69b4eece46a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:58.784674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10b4bd-8ea5-461e-8821-e69b4eece46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:58.784950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10b4bd-8ea5-461e-8821-e69b4eece46a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:58.785806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10b4bd-8ea5-461e-8821-e69b4eece46a admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=9d58693d11544e18a74ccda41182d77e, scope.project.id=0d7b577b01e44156a30ea00705ebb430) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:58.786117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10b4bd-8ea5-461e-8821-e69b4eece46a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:58.788054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10b4bd-8ea5-461e-8821-e69b4eece46a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:58.796256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 213/430] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:58 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=9d58693d11544e18a74ccda41182d77e => generated 611 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:59.115431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5847-9b03-495a-ae78-2e90ffc9ffed None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.116069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5847-9b03-495a-ae78-2e90ffc9ffed None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.116541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c5847-9b03-495a-ae78-2e90ffc9ffed None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.118745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 218/431] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:59.125361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e346-461c-4666-ab1b-bfa4cb8cdac6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.125928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e346-461c-4666-ab1b-bfa4cb8cdac6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.126439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68e346-461c-4666-ab1b-bfa4cb8cdac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.147809 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-fd68e346-461c-4666-ab1b-bfa4cb8cdac6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:59.149308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fd68e346-461c-4666-ab1b-bfa4cb8cdac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:59.159823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 214/432] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:59.183976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c5847-9b03-495a-ae78-2e90ffc9ffed None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.196841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c5847-9b03-495a-ae78-2e90ffc9ffed None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.201686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.202672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.203122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.203535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.215221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:59.222628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:25:59.224010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 219/433] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:59.229979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e346-461c-4666-ab1b-bfa4cb8cdac6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.239859 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68e346-461c-4666-ab1b-bfa4cb8cdac6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.245053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.245868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.246310 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.246724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.247645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:59.248089 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.249881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.258642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 215/434] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:25:59.264429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.275095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2d5e-3ddc-405a-a7d4-17475c86334a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.280455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.281311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.281816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.282543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.291403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.293651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.303835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 220/435] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:59.310451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.320773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60232c-c193-4324-80a0-e26f56651ae7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.325726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.326892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.327371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.327907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.329372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.331766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.334021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 216/436] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:59.340142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.349476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b46f-76c2-400a-86f1-9c8cf5ecea25 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.356072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5fa65-15eb-4a01-bf61-dd5f7cfcd7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.356914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5fa65-15eb-4a01-bf61-dd5f7cfcd7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.357188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5fa65-15eb-4a01-bf61-dd5f7cfcd7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.357449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5fa65-15eb-4a01-bf61-dd5f7cfcd7c8 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.358643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5fa65-15eb-4a01-bf61-dd5f7cfcd7c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.360561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5fa65-15eb-4a01-bf61-dd5f7cfcd7c8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.362280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 221/437] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:59.368811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.379490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e616a8-2cd8-4c12-a78f-2f0b2f7e3595 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.386305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d9c9d-dee5-4c18-97e5-4bee70f7e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.387270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d9c9d-dee5-4c18-97e5-4bee70f7e3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.387749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d9c9d-dee5-4c18-97e5-4bee70f7e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.388216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d9c9d-dee5-4c18-97e5-4bee70f7e3f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.389265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d9c9d-dee5-4c18-97e5-4bee70f7e3f2 admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=0d7b577b01e44156a30ea00705ebb430) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:59.389810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d9c9d-dee5-4c18-97e5-4bee70f7e3f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.391893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d9c9d-dee5-4c18-97e5-4bee70f7e3f2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.399020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 217/438] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=0d7b577b01e44156a30ea00705ebb430&role.id=8fce00171f5149e2b0de6dffe397598a => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:59.667682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e277cba-7f1c-4595-be8a-109fa0a2436d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.667898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e277cba-7f1c-4595-be8a-109fa0a2436d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.668176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e277cba-7f1c-4595-be8a-109fa0a2436d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.669974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 222/439] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:25:59.675476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691dd1-3f3c-4d78-a5f8-1622718719e8 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.675762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691dd1-3f3c-4d78-a5f8-1622718719e8 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.676037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4691dd1-3f3c-4d78-a5f8-1622718719e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.695690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c4691dd1-3f3c-4d78-a5f8-1622718719e8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:25:59.696889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c4691dd1-3f3c-4d78-a5f8-1622718719e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:25:59.705666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 218/440] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:25:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:25:59.729974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e277cba-7f1c-4595-be8a-109fa0a2436d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.742263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e277cba-7f1c-4595-be8a-109fa0a2436d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.747032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.747813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.748095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.748373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.759437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:25:59.766969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:25:59.768404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 223/441] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:25:59.774266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4691dd1-3f3c-4d78-a5f8-1622718719e8 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.785572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4691dd1-3f3c-4d78-a5f8-1622718719e8 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.790299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.791817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.792245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.792518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.793276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:59.793575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.795224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.804081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 219/442] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:59.810432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.820704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f879dc-d9ac-48a9-a531-8e2e0a3b02dd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.825389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.826016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.826290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.826557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.835270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.837024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.846179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 224/443] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:25:59.851856 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.863639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a38aa3-13ae-43a9-b940-9c3307c28507 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.868219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.869159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.869479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.869708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.871209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.873049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.875182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 220/444] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:59.880694 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.891315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411c05-0d79-4e39-908b-d5f0c126e7b2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.897762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818b9c9-c734-4757-947a-1e22c5ec90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.898620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818b9c9-c734-4757-947a-1e22c5ec90ef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.898951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818b9c9-c734-4757-947a-1e22c5ec90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.899221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818b9c9-c734-4757-947a-1e22c5ec90ef admin admin] PATH_INFO: `/v3/groups/a1144a3f7b6841ba9f6f29656d483079` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.900509 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818b9c9-c734-4757-947a-1e22c5ec90ef admin admin] RBAC: Authorizing `identity:get_group(group_id=a1144a3f7b6841ba9f6f29656d483079)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.902398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818b9c9-c734-4757-947a-1e22c5ec90ef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.904277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 225/445] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/groups/a1144a3f7b6841ba9f6f29656d483079 => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:25:59.909977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:25:59.920203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8e514-d121-4cbd-8529-6ffe076c9de6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:25:59.924645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6afdbd-5423-4748-8231-3ba9f843d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:25:59.925276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afdbd-5423-4748-8231-3ba9f843d894 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:25:59.925556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afdbd-5423-4748-8231-3ba9f843d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:25:59.925822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6afdbd-5423-4748-8231-3ba9f843d894 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:25:59.926654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6afdbd-5423-4748-8231-3ba9f843d894 admin admin] RBAC: Adding query filter params (group.id=a1144a3f7b6841ba9f6f29656d483079, role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=6434f6a5574340a59ffe3c6ae995c685) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:25:59.927028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6afdbd-5423-4748-8231-3ba9f843d894 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:25:59.928858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6afdbd-5423-4748-8231-3ba9f843d894 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:25:59.935885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 221/446] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:25:59 2022] GET /identity/v3/role_assignments?group.id=a1144a3f7b6841ba9f6f29656d483079&scope.project.id=6434f6a5574340a59ffe3c6ae995c685&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:00.123080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372e35b-390f-4598-8aeb-c8542d45eb2e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.123360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372e35b-390f-4598-8aeb-c8542d45eb2e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.123635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372e35b-390f-4598-8aeb-c8542d45eb2e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.125412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 226/447] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:00.130657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3766-25cc-4145-8557-4b34fcaca9b6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.130988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3766-25cc-4145-8557-4b34fcaca9b6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.131268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab3766-25cc-4145-8557-4b34fcaca9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.149099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-2fab3766-25cc-4145-8557-4b34fcaca9b6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:00.150997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-2fab3766-25cc-4145-8557-4b34fcaca9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:00.158467 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 222/448] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:00.182819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372e35b-390f-4598-8aeb-c8542d45eb2e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:00.194516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372e35b-390f-4598-8aeb-c8542d45eb2e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:00.199684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:00.200455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.200730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.200996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.210912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:00.218486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:26:00.219638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 227/449] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:00.225043 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab3766-25cc-4145-8557-4b34fcaca9b6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:00.233747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab3766-25cc-4145-8557-4b34fcaca9b6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:00.238009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:00.238637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.238953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.239224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.239965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:00.240260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:00.241825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:00.250198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 223/450] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:00.255234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:00.264963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39607e-5b60-4adb-a76d-d657919abbd5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:00.269175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:00.269770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.270045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.270315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.278239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:00.279995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:00.288597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 228/451] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:00.294389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:00.303415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe5f28-a85c-4388-848c-d12fde0546d1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:00.308361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:00.309153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.309426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.309693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] PATH_INFO: `/v3/projects/b98b4d38393444778c0cb2025d06fc52` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.310881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=b98b4d38393444778c0cb2025d06fc52)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:00.312874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:00.314465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 224/452] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:26:00 2022] GET /identity/v3/projects/b98b4d38393444778c0cb2025d06fc52 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:00.319181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:00.327424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00104c-bdac-403f-a93a-ee269d5012d1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:00.331575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0be3-3176-4468-b8a4-38070075e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:00.332364 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0be3-3176-4468-b8a4-38070075e539 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.332637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0be3-3176-4468-b8a4-38070075e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.332904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0be3-3176-4468-b8a4-38070075e539 admin admin] PATH_INFO: `/v3/groups/2b5305a19d9c41cbb45289a68427e11a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.334044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0be3-3176-4468-b8a4-38070075e539 admin admin] RBAC: Authorizing `identity:get_group(group_id=2b5305a19d9c41cbb45289a68427e11a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:00.335894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0be3-3176-4468-b8a4-38070075e539 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:00.337380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 229/453] 10.222.0.21 () {56 vars in 1201 bytes} [Mon Jan 31 04:26:00 2022] GET /identity/v3/groups/2b5305a19d9c41cbb45289a68427e11a => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:00.342590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:00.351614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31232f-3ed3-49c6-be2c-d8e7ba8326e7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:00.356414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a486b7-9312-428d-a98d-6b95357751a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:00.356996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a486b7-9312-428d-a98d-6b95357751a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:00.357269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a486b7-9312-428d-a98d-6b95357751a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:00.357534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a486b7-9312-428d-a98d-6b95357751a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:00.358331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a486b7-9312-428d-a98d-6b95357751a8 admin admin] RBAC: Adding query filter params (group.id=2b5305a19d9c41cbb45289a68427e11a, role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=b98b4d38393444778c0cb2025d06fc52) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:00.358627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a486b7-9312-428d-a98d-6b95357751a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:00.360441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a486b7-9312-428d-a98d-6b95357751a8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:00.365909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 225/454] 10.222.0.21 () {56 vars in 1397 bytes} [Mon Jan 31 04:26:00 2022] GET /identity/v3/role_assignments?group.id=2b5305a19d9c41cbb45289a68427e11a&scope.project.id=b98b4d38393444778c0cb2025d06fc52&role.id=8fce00171f5149e2b0de6dffe397598a => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:03.225531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc7e6-29e5-4b62-aa56-55a2e3572329 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.226523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc7e6-29e5-4b62-aa56-55a2e3572329 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.227035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadc7e6-29e5-4b62-aa56-55a2e3572329 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.229665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 230/455] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:03.249345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb9df-7f8c-47b2-b361-def5d65efcbf None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.249896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb9df-7f8c-47b2-b361-def5d65efcbf None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.249896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdb9df-7f8c-47b2-b361-def5d65efcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.280739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-25bdb9df-7f8c-47b2-b361-def5d65efcbf None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:03.281926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-25bdb9df-7f8c-47b2-b361-def5d65efcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:03.294672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 226/456] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:03.327821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadc7e6-29e5-4b62-aa56-55a2e3572329 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.344930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadc7e6-29e5-4b62-aa56-55a2e3572329 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.355095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.355883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.356165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.356435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.367164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.369093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.390716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:03.392263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 231/457] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:03.397538 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdb9df-7f8c-47b2-b361-def5d65efcbf None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.412108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdb9df-7f8c-47b2-b361-def5d65efcbf None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.424906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cebbc3-f186-4f71-9fd3-233cf2c8614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.425571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cebbc3-f186-4f71-9fd3-233cf2c8614d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.425853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cebbc3-f186-4f71-9fd3-233cf2c8614d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.426130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cebbc3-f186-4f71-9fd3-233cf2c8614d admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.426926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cebbc3-f186-4f71-9fd3-233cf2c8614d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:03.427230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cebbc3-f186-4f71-9fd3-233cf2c8614d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.428839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cebbc3-f186-4f71-9fd3-233cf2c8614d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.448684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 227/458] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:03.453670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.467902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d608d29-a0a5-42fe-9fc2-280d3c76bbb4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.479109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.479787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.480070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.480338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.481076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.481307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181322f-0af8-4dc5-9f22-eb05356dfa9a None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.481600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181322f-0af8-4dc5-9f22-eb05356dfa9a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.481880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181322f-0af8-4dc5-9f22-eb05356dfa9a None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.483051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.483922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 228/459] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:03.489111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce3c36-d149-41fb-9dc4-cab53d274052 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.489395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce3c36-d149-41fb-9dc4-cab53d274052 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.489678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce3c36-d149-41fb-9dc4-cab53d274052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.510913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-01ce3c36-d149-41fb-9dc4-cab53d274052 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:03.512107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-01ce3c36-d149-41fb-9dc4-cab53d274052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:03.522766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 229/460] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:03.524795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ba9c-34e5-4d35-89ab-cfcd23e0e7c9 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.525399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ba9c-34e5-4d35-89ab-cfcd23e0e7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.526158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ba9c-34e5-4d35-89ab-cfcd23e0e7c9 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.528900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 230/461] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:03.535300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e723c-adca-455c-8e4e-26f1b9a03144 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.535851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e723c-adca-455c-8e4e-26f1b9a03144 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.536321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e723c-adca-455c-8e4e-26f1b9a03144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.556854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c14e723c-adca-455c-8e4e-26f1b9a03144 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:03.558161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c14e723c-adca-455c-8e4e-26f1b9a03144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:03.566225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 231/462] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:03.566802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e723c-adca-455c-8e4e-26f1b9a03144 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.582286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e723c-adca-455c-8e4e-26f1b9a03144 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.587559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.588577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.588855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.589127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.593513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 232/463] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:26:03 2022] POST /identity/v3/users => generated 246 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:03.600848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.602942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.607993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.635251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866165b-4bd7-42d6-a11d-66c900aef1f9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.643114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:03.645780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 232/464] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:03.651605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.654881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.655693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.655979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.656254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.670769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d4fc-0b22-4a7a-aa0d-b4e49a807e84 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.679486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.680550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.681760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.683066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.683583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.685677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.686725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:03.687306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.689465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.721823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 233/465] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:03.726983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:03.733768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 233/466] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:03.735485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.747579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.754707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ffd62-05d2-431e-aadd-a354005a9222 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.762077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354b5e-b27a-455e-aea2-29f2f69b3f7e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.767025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.768539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.769978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.770665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.771978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:03.773210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c8625-64c2-4c97-b1a1-f7349a69e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.773716 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.774561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8625-64c2-4c97-b1a1-f7349a69e617 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.776075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8625-64c2-4c97-b1a1-f7349a69e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.776702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8625-64c2-4c97-b1a1-f7349a69e617 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.777656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.778714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c8625-64c2-4c97-b1a1-f7349a69e617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.781006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c8625-64c2-4c97-b1a1-f7349a69e617 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.792078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 234/467] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:03.797436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.809229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d861-d032-425e-9ac8-7f547ef1ebb9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:03.813905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:03.814774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.815278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.815719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.816599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:03.818685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:03.894925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 234/468] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:26:03 2022] POST /identity/v3/users => generated 248 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:26:03.896710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67a5d-e4fe-4bf0-8078-869bd512e808 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.897168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67a5d-e4fe-4bf0-8078-869bd512e808 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.897580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67a5d-e4fe-4bf0-8078-869bd512e808 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.899827 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 235/469] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:03.905594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806fccb-377b-4433-aaac-3da74d69d19f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:03.905883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806fccb-377b-4433-aaac-3da74d69d19f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:03.909365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806fccb-377b-4433-aaac-3da74d69d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:03.926914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d806fccb-377b-4433-aaac-3da74d69d19f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:03.928211 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d806fccb-377b-4433-aaac-3da74d69d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:03.936423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 235/470] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:26:03 2022] POST /identity/v3/users => generated 248 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:03.945074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 236/471] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:03.985434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:03.997485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574f18e-1236-493a-a025-e6d7ce43e17a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:04.006955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:04.008225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:04.008749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:04.009224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:04.022537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:04.024810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:04.045017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:04.046988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 236/472] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:04.054129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806fccb-377b-4433-aaac-3da74d69d19f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:04.068492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806fccb-377b-4433-aaac-3da74d69d19f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:04.084351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:04.085046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:04.085328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:04.085599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:04.086347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:04.086661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:04.087801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:04.087801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:26:04.087801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:26:04.088693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d2be-d508-4b0d-8823-5d463a6dee02 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:04.125323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 237/473] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:04.131431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:04.144341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6d7d9-0d4b-4703-b659-ba999d0960e6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:04.155144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ab6a-05b2-403e-837b-95a75d3572ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:04.156258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ab6a-05b2-403e-837b-95a75d3572ff admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:04.156731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ab6a-05b2-403e-837b-95a75d3572ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:04.157506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ab6a-05b2-403e-837b-95a75d3572ff admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:04.158425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ab6a-05b2-403e-837b-95a75d3572ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:04.163033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ab6a-05b2-403e-837b-95a75d3572ff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:04.244327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 237/474] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:26:04 2022] POST /identity/v3/users => generated 249 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:04.767922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97fcb0-2533-4aff-a1d4-9a2ddbd567a4 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:04.768954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97fcb0-2533-4aff-a1d4-9a2ddbd567a4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:04.769436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97fcb0-2533-4aff-a1d4-9a2ddbd567a4 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:04.771690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 238/475] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:04.778943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818314d2-983d-4380-9ca8-2d427cc2c17d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:04.779783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818314d2-983d-4380-9ca8-2d427cc2c17d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:04.780258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818314d2-983d-4380-9ca8-2d427cc2c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:04.801974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-818314d2-983d-4380-9ca8-2d427cc2c17d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:04.803545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-818314d2-983d-4380-9ca8-2d427cc2c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:04.811886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 238/476] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:04.835411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97fcb0-2533-4aff-a1d4-9a2ddbd567a4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:04.849251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97fcb0-2533-4aff-a1d4-9a2ddbd567a4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:04.854664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:04.855601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:04.856083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:04.856552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:04.857535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:04.859374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:04.903944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.sql.core [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 31 04:26:04.903944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 31 04:26:04.903944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [parameters: {'id': 'a17f99e3c4d6450d8e8a06b0b87f5384', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 31 04:26:04.903944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79339) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 31 04:26:04.927522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 31 04:26:04.929561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 239/477] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:26:04 2022] POST /identity/v3/roles => generated 144 bytes in 94 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:04.935950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818314d2-983d-4380-9ca8-2d427cc2c17d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:04.945415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818314d2-983d-4380-9ca8-2d427cc2c17d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:04.955417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee9ad3-3918-42da-94f8-b307dbbfddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:04.956501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9ad3-3918-42da-94f8-b307dbbfddaa admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:04.957001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9ad3-3918-42da-94f8-b307dbbfddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:04.957469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9ad3-3918-42da-94f8-b307dbbfddaa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:04.970336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee9ad3-3918-42da-94f8-b307dbbfddaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:04.977909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-0cee9ad3-3918-42da-94f8-b307dbbfddaa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 31 04:26:04.980293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 239/478] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:04.986007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:04.997717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87538657-dca6-4baa-8ba2-e4548ec19918 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:05.004396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d7a50-b833-4f0e-b8e2-9769a11b1a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:05.005286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d7a50-b833-4f0e-b8e2-9769a11b1a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:05.005805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d7a50-b833-4f0e-b8e2-9769a11b1a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:05.006280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d7a50-b833-4f0e-b8e2-9769a11b1a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:05.007346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d7a50-b833-4f0e-b8e2-9769a11b1a28 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:05.007851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d7a50-b833-4f0e-b8e2-9769a11b1a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:05.010465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d7a50-b833-4f0e-b8e2-9769a11b1a28 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:05.019945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 240/479] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:06.219996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe43a9-429d-4365-8642-33b1b1dae26f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.220524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe43a9-429d-4365-8642-33b1b1dae26f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.220524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe43a9-429d-4365-8642-33b1b1dae26f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.222489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 240/480] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:06.228011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499fd8e-ca85-40f5-89d9-c630614d3119 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.228646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499fd8e-ca85-40f5-89d9-c630614d3119 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.228646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499fd8e-ca85-40f5-89d9-c630614d3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.255810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b499fd8e-ca85-40f5-89d9-c630614d3119 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:06.257009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b499fd8e-ca85-40f5-89d9-c630614d3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:06.267681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 241/481] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:06.304129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe43a9-429d-4365-8642-33b1b1dae26f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.327504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe43a9-429d-4365-8642-33b1b1dae26f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.332068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.332849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.333127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.333397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.352385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:06.360344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:06.361535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 241/482] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:06.367520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499fd8e-ca85-40f5-89d9-c630614d3119 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.384943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499fd8e-ca85-40f5-89d9-c630614d3119 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.394867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.395539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.395819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.396093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.396857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:06.397158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.398764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.412907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 242/483] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:06.419291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.429246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8272-2f35-4495-9836-8d480c0b7693 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.439122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.439909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.440188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.440465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.457357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.459242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.481844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:06.483074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 242/484] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:06.488548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.513260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005182-a2b2-4947-a81d-aaff707e2503 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.527433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.528103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.528385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.528659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.529403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:06.529703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.531422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.549516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 243/485] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:06.555740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.564996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204828c2-3fc7-4a0c-8023-a97a0aaa8188 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.580353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa73f6a-6de3-43b7-b428-204e7df29616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.581156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa73f6a-6de3-43b7-b428-204e7df29616 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.581439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa73f6a-6de3-43b7-b428-204e7df29616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.581719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa73f6a-6de3-43b7-b428-204e7df29616 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.596939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa73f6a-6de3-43b7-b428-204e7df29616 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.599048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa73f6a-6de3-43b7-b428-204e7df29616 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.613996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-3aa73f6a-6de3-43b7-b428-204e7df29616 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:06.615600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 243/486] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:06.623214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.640719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69455f5-60e8-4fdd-90c9-692eecfea80f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.655650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.656345 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.656648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.656903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.658031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:06.658333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.659378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:06.659378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:26:06.659378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:26:06.660532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.703214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a6f4c-8fcb-4040-8872-93913e271644 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.703523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a6f4c-8fcb-4040-8872-93913e271644 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.703700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a6f4c-8fcb-4040-8872-93913e271644 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.705666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 244/487] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:06.711047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281476d8-0ed5-4953-8930-8b6d42d876b1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.711327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281476d8-0ed5-4953-8930-8b6d42d876b1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.711493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 244/488] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:06.711661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281476d8-0ed5-4953-8930-8b6d42d876b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.717631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.727237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049e62-8f7f-406d-9251-ce2978706b7e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.732328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.733072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.733353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.733628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.741940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.744440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.751790 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-281476d8-0ed5-4953-8930-8b6d42d876b1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:06.752982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-281476d8-0ed5-4953-8930-8b6d42d876b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:06.754106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 245/489] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:26:06.760418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.770055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32a529-b595-4428-a8ed-9cfa5391512a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.772914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 245/490] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:06.775305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.776368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.776701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.776973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.788382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.790272 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.808772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:06.810314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 246/491] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:06.815708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281476d8-0ed5-4953-8930-8b6d42d876b1 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.816991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.832836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb20ab-4315-400a-9d0c-97c63e3d69b7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.835536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281476d8-0ed5-4953-8930-8b6d42d876b1 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.843583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.845402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.846228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.846506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.846773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.847424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.848092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.848358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.849021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:06.849373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.851055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.871881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:06.878860 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:06.880066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 247/492] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:06.881119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 246/493] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:06.886891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.892057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.901518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a71e39-59dc-4e32-8fd7-633adaf0f5f8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.906109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.906839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.907380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.907658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.908459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:06.908728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6caf99-25d9-4fa6-a941-e9e7d883a38a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.908833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.910555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.920662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 248/494] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:06.926064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.931006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b44c6-fdc1-4b09-b69f-a73b08baf9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.932337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b44c6-fdc1-4b09-b69f-a73b08baf9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.932617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b44c6-fdc1-4b09-b69f-a73b08baf9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.932888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b44c6-fdc1-4b09-b69f-a73b08baf9eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.937657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e227d0-31e2-4a41-903b-a6b4831dbc16 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:06.942050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:06.943026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.943309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.943583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.947989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b44c6-fdc1-4b09-b69f-a73b08baf9eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.949965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b44c6-fdc1-4b09-b69f-a73b08baf9eb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.954849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:06.957023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:06.979873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:06.981247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 249/495] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:06.985097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-486b44c6-fdc1-4b09-b69f-a73b08baf9eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:06.986467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:06.986667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 247/496] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:06.994554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ed56-97fe-42b7-9fcf-c261b41b33e4 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:06.994866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ed56-97fe-42b7-9fcf-c261b41b33e4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:06.995289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ed56-97fe-42b7-9fcf-c261b41b33e4 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:06.998320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 248/497] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:07.000997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e6b80-9777-4a4c-8403-4bc3e8e8b251 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.001705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7ed56-97fe-42b7-9fcf-c261b41b33e4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.006139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f97ce-36ba-462e-baaa-85c43918d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.006845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f97ce-36ba-462e-baaa-85c43918d7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.007134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f97ce-36ba-462e-baaa-85c43918d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.007494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f97ce-36ba-462e-baaa-85c43918d7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.008226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f97ce-36ba-462e-baaa-85c43918d7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.008798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f97ce-36ba-462e-baaa-85c43918d7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.011475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f97ce-36ba-462e-baaa-85c43918d7ec admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.014700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7ed56-97fe-42b7-9fcf-c261b41b33e4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.019137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.019772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.020050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.020322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.021113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.021414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.022433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:07.022433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:26:07.022433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:26:07.023587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.026814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 250/498] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:07.030974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706e34-a72d-4579-aa58-0d5d85187079 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.031292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706e34-a72d-4579-aa58-0d5d85187079 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.031568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706e34-a72d-4579-aa58-0d5d85187079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.049083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 249/499] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.049979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.061013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9a706e34-a72d-4579-aa58-0d5d85187079 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:07.062239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9a706e34-a72d-4579-aa58-0d5d85187079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:07.069230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f331a92-dcae-4a20-bb35-d050b61d9fb8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.070969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 251/500] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:07.075814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.076231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706e34-a72d-4579-aa58-0d5d85187079 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.076759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.077151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.077563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.090826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.090826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.102831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706e34-a72d-4579-aa58-0d5d85187079 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.105022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 31 04:26:07.106804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 250/501] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.107710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.113729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.114381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.114661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.114962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.115812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=bf69b08068054c4180f2d44c9c07cb60) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.116116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.117978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.118109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4fa59-bd6f-4633-ae7f-87ad7569913f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.123754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.124573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.124842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 252/502] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/role_assignments?user.id=bf69b08068054c4180f2d44c9c07cb60&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.124968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.125165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.125707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.135578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea971126-b1bd-4e7c-ac1b-b94a76c479dd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.148606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.149295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.149571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.149875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.150754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.151095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.152993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.155840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:07.163143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:07.169900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 251/503] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.171419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.186840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78763e84-41ef-4ddd-8e5d-c50de47adcbc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.187298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.187970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.188248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.188519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.189287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.189588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.191266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.192388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 253/504] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.198924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.209947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 252/505] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:07.211360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.218392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f54d85-1d98-432c-b8cd-36d5fab6ad0f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.221304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fe50b-7e28-4efc-acf8-3b48789756fd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.225966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.227007 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.227365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.227698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.236265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.236929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.237215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.237491 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.241352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.243472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.255957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.257762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.262726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:07.268775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 253/506] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.270500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.280820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471abe-808e-44cb-93ff-b55e5205eb73 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.286688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 254/507] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:07.291414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9c91f-e566-4ece-85d0-5a9cfe89fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.292416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9c91f-e566-4ece-85d0-5a9cfe89fe71 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.292902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9c91f-e566-4ece-85d0-5a9cfe89fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.293367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9c91f-e566-4ece-85d0-5a9cfe89fe71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.294329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9c91f-e566-4ece-85d0-5a9cfe89fe71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.294877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9c91f-e566-4ece-85d0-5a9cfe89fe71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.296726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9c91f-e566-4ece-85d0-5a9cfe89fe71 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.300117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.314444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09145bc2-5dfb-4573-8ee2-cdcb529ec0ef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.319230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 254/508] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.321659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df236-4479-46be-a359-467bc1d3e332 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.322479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df236-4479-46be-a359-467bc1d3e332 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.322765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540df236-4479-46be-a359-467bc1d3e332 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.324761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 255/509] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:07.325307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df236-4479-46be-a359-467bc1d3e332 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.329100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a69dc-a540-476f-9b6c-624129e1a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.330026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a69dc-a540-476f-9b6c-624129e1a22d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.330294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a69dc-a540-476f-9b6c-624129e1a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.330569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a69dc-a540-476f-9b6c-624129e1a22d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.340662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540df236-4479-46be-a359-467bc1d3e332 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.344377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a69dc-a540-476f-9b6c-624129e1a22d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.345781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.346553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a69dc-a540-476f-9b6c-624129e1a22d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.347053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.347553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.348013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.357406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.359762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.367511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c64a69dc-a540-476f-9b6c-624129e1a22d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:07.373285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 255/510] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:07.373285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef114d8-46e6-4547-8f98-79fe81376b9f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.373285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef114d8-46e6-4547-8f98-79fe81376b9f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.373285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef114d8-46e6-4547-8f98-79fe81376b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.382804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 31 04:26:07.389306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 256/511] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.389867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.391188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fef114d8-46e6-4547-8f98-79fe81376b9f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:07.392378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fef114d8-46e6-4547-8f98-79fe81376b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:07.400816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 256/512] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:07.401440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef114d8-46e6-4547-8f98-79fe81376b9f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.403297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd65760-c9d3-4953-b3ba-0458048b0eb0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.408434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.409382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.409872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.410401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.411485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.412030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.413953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.419941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef114d8-46e6-4547-8f98-79fe81376b9f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.433052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 257/513] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.434658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.439243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.439967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.440258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.440526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.441388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.441696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.443644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.447171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19e20-c60a-4332-942c-746eea9da04d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.452129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.453238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.453735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.454245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.461722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 257/514] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.466780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.467225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.469425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.477183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81ae8-14a2-4b6a-8501-b95d5ecdce37 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.482205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.483291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.483760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.484176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.484756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:07.486382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 258/515] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:07.491586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.497974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:07.504116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67525cb0-d3d2-437c-a673-f7bffc974986 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.505551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:07.506974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 258/516] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.512623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.512750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.512750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.512750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.512750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.519776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.521664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.523193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf2833-688f-4464-a800-53064d5eb9e7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.528738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.529651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.530147 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.530611 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.531728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.532464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.533820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:07.533820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:26:07.533820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:26:07.535368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.537704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 259/517] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:07.538669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.548554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e901f-1a29-4d99-aeb3-7537356b679a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.553153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.553559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.553911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.554249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.555101 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.555472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.557746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.558880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 259/518] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.560016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.573584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca14612-a0a4-4dea-b786-4d0bcbbb83f0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.573780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 260/519] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.574834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.583224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.584095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.585003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.585003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.586444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d309a0-9699-42c6-8845-218ad193f19c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.591719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.592482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.592829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.593168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.594168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=72317f5c187c41e9b2d1c53c9cedcd1a) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.594540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.596573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.598720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.600593 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.611007 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 261/520] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/role_assignments?user.id=72317f5c187c41e9b2d1c53c9cedcd1a&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.612114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.617654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:07.619804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 260/521] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.629381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba983865-77c4-47c0-af61-7df215cd0c11 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.630632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.634475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.635418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.635739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.636009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.648039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.650671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.653586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc28e-0b7b-4f86-a800-707ca0b1cfd5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.667591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.668265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.668547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.668818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.669573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.669877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.670394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:07.671522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.671981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 262/522] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.681653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.701850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be3dd-b3d4-46ea-a9f6-49d30655bb13 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.707058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 261/523] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.711559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.713145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.713392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.713651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.714245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.714544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.716361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.726601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.738897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcfab7-92cb-4ca8-9065-7fa7c578e306 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.747410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 263/524] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.751494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.752319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.752598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.752871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.753111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.767424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.771011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.773861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4384e8-52fb-4c6b-ab0a-e5dd440741c6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.784719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.786419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.786762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.787097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.803771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:07.806262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 262/525] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:07.811026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.813136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.828357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.832368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 31 04:26:07.833587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 264/526] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:07.840406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.848515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da068-9689-492d-84d4-a5459b5ea6aa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.857065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.858154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13562e35-4bd4-42cb-ab32-1ab84d7cf015 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.858661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.859019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.859297 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.860099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.860408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.865684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.866887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.869476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.869730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.871054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.871963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.872266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.876250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:07.876250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:26:07.876250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:26:07.877446 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.896929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 263/527] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.919841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.926775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 265/528] 10.222.0.21 () {56 vars in 1160 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:07.938020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.948348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf753-c0b4-4b2e-8791-f085a6d50298 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.950897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a6d0d-469a-430a-8e06-97abbe6a0907 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:07.953479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363db19d-40cd-468d-80db-3ce8b15c6463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.954303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db19d-40cd-468d-80db-3ce8b15c6463 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.954716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db19d-40cd-468d-80db-3ce8b15c6463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.955105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363db19d-40cd-468d-80db-3ce8b15c6463 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.955525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:07.956018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db19d-40cd-468d-80db-3ce8b15c6463 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=7b6b83d1d42045bdad91bf814b54a7f6) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:07.956192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.956344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db19d-40cd-468d-80db-3ce8b15c6463 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.956499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.956679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.958423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363db19d-40cd-468d-80db-3ce8b15c6463 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.965158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:07.966971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:07.970964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 264/529] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/role_assignments?user.id=7b6b83d1d42045bdad91bf814b54a7f6&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:07.972515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ede11-ed56-4592-b047-9dd7b90bda0e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.972856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ede11-ed56-4592-b047-9dd7b90bda0e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.973137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ede11-ed56-4592-b047-9dd7b90bda0e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.975334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 265/530] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:07.976780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 266/531] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:07.983292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5a25b-283a-429a-8b48-48a9da3086e1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:07.983595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5a25b-283a-429a-8b48-48a9da3086e1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:07.983834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5a25b-283a-429a-8b48-48a9da3086e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:07.986207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:07.999402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04d1f9-2691-4e9b-b1cc-1b42e2769deb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.013239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.014094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.014375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.015977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.028082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cef5a25b-283a-429a-8b48-48a9da3086e1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:08.029361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cef5a25b-283a-429a-8b48-48a9da3086e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:08.031837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.034046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.040325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 266/532] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:08.065479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:08.067098 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 267/533] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:08.072730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5a25b-283a-429a-8b48-48a9da3086e1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:08.090843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5a25b-283a-429a-8b48-48a9da3086e1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.101351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:08.111620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.112315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.112603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.112888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.113656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:08.113962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.114870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103231-8a44-46b1-bd30-23811cdd63dd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.115650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.126458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.127366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.128192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.128473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.143522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 267/534] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:08.148747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:08.153157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.155847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.158812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4256261-b6e7-4013-8506-e3afe1b1020e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.168838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.169680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.169909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.170182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.177639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:08.177755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.180578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.181989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 268/535] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:08.187699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:08.198037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:08.199058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1de6a-d352-4081-a29a-c28057358136 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.199168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 268/536] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:08.207569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:08.211260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.211976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.212770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.214921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.215721 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:08.216027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.220923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.225969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba467a4-b2ac-4bdd-a97e-05a62f1a0d93 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.237169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.237891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.239020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.239298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.240323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:08.242253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.244421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 269/537] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:08.245471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.250563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:08.267044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9ec45-d2dd-4772-ab8b-8ea24afc06b6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.275382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 269/538] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:08.277948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7eb88-79a8-4197-a582-5b9493110a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.278610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7eb88-79a8-4197-a582-5b9493110a55 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.278951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7eb88-79a8-4197-a582-5b9493110a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.279239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7eb88-79a8-4197-a582-5b9493110a55 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.279955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7eb88-79a8-4197-a582-5b9493110a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.282295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7eb88-79a8-4197-a582-5b9493110a55 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.292296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:08.303613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0803-def7-43a9-9515-6d96b1b0761e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:08.310939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ec50d-8ca7-4f04-8738-206ed786faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:08.311591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ec50d-8ca7-4f04-8738-206ed786faf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:08.311869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ec50d-8ca7-4f04-8738-206ed786faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:08.312197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ec50d-8ca7-4f04-8738-206ed786faf5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:08.313038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ec50d-8ca7-4f04-8738-206ed786faf5 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=889a6422677047b6a75d1480f156ead7) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:08.313392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ec50d-8ca7-4f04-8738-206ed786faf5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:08.315456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ec50d-8ca7-4f04-8738-206ed786faf5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:08.321787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 270/539] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:08 2022] GET /identity/v3/role_assignments?user.id=889a6422677047b6a75d1480f156ead7&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:08.381123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 270/540] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:26:08 2022] POST /identity/v3/users => generated 247 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:26:09.738874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425bc12-5cbf-4f38-9758-5524b8a6376e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:09.739468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425bc12-5cbf-4f38-9758-5524b8a6376e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:09.739645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425bc12-5cbf-4f38-9758-5524b8a6376e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:09.741749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 271/541] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:09.747999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ead134-2268-417d-8560-5d0f397c8ab9 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:09.748513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ead134-2268-417d-8560-5d0f397c8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:09.748513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ead134-2268-417d-8560-5d0f397c8ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:09.771170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-89ead134-2268-417d-8560-5d0f397c8ab9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:09.772356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-89ead134-2268-417d-8560-5d0f397c8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:09.785120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 271/542] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:09.823436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425bc12-5cbf-4f38-9758-5524b8a6376e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:09.840761 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425bc12-5cbf-4f38-9758-5524b8a6376e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:09.846904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:09.847914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:09.848396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:09.848867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:09.866332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:09.875443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:09.877133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 272/543] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:09.882605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ead134-2268-417d-8560-5d0f397c8ab9 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:09.895072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ead134-2268-417d-8560-5d0f397c8ab9 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:09.908213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:09.908885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:09.909165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:09.909487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:09.910250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:09.910552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:09.912182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:09.921391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 272/544] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:09.926696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:09.941216 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd3614-946e-4192-902c-8b02d86046fc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:09.950503 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:09.951574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:09.952059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:09.952545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:09.972891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:09.975074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:09.999182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:10.000961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 273/545] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:10.010816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.020122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108937-90fd-4205-b38e-3265b26e5e59 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.036694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.037368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.037640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.037904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.038639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.038963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.040759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.061005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 273/546] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:10.066493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.099164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f3d4-383d-49f7-95de-7c7fd98b8abd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.105165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.106202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.106686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.107194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.117951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.120424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.141704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:10.143272 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 274/547] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:10.149006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.164642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7167d9-a439-4e72-95b1-ac7e2386b024 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.180408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.181369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.181697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.181971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.182838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.183143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.185009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.215684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 274/548] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:10.220833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.236060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec487f-9942-4a0c-b4cf-d0baa5da0eca admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.243637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.244891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.245429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.245906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.264130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.266502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.289514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:10.291190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 275/549] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:10.296760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.307671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33544a8d-d2df-48b3-a060-176eec7481b9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.316279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.316932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.317208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.317476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.318206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.318505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.320295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.337829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 275/550] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:10.343407 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.355734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3e737-5b7c-422e-b397-01c3f835c6cb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.364760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.365544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.365820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.366082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.375919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.377904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.394072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:10.395282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 276/551] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:10.401089 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.412769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dab46-cffd-401e-95ac-3b858f0a7bb0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.420268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4e80-cda4-47f9-96dc-a1340c493900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.420918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4e80-cda4-47f9-96dc-a1340c493900 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.421193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4e80-cda4-47f9-96dc-a1340c493900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.421459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4e80-cda4-47f9-96dc-a1340c493900 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.422251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4e80-cda4-47f9-96dc-a1340c493900 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.422539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4e80-cda4-47f9-96dc-a1340c493900 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.424426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4e80-cda4-47f9-96dc-a1340c493900 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.442491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 276/552] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:10.448724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.459573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539eba-61a8-4044-b94a-cad35e38ec5b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.469764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.470635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.470940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.471213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/bf69b08068054c4180f2d44c9c07cb60/roles/a36d2857a03b44cc8c9eaad52457f4f3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.488910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=bf69b08068054c4180f2d44c9c07cb60, role_id=a36d2857a03b44cc8c9eaad52457f4f3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.491622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.509888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f780-5e6a-498d-9b6a-2f420bebeb53 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.525598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f780-5e6a-498d-9b6a-2f420bebeb53 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.525598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f780-5e6a-498d-9b6a-2f420bebeb53 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.525598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 277/553] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:10.525598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c6686-5773-4b99-9b22-eb1fa948b428 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.525598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c6686-5773-4b99-9b22-eb1fa948b428 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.525598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c6686-5773-4b99-9b22-eb1fa948b428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.536302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e93c6686-5773-4b99-9b22-eb1fa948b428 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:10.537565 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e93c6686-5773-4b99-9b22-eb1fa948b428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:10.547514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 278/554] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:10.548749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e435-d7f4-4174-a815-cab1dac21ba2 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.549079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e435-d7f4-4174-a815-cab1dac21ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.549414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e435-d7f4-4174-a815-cab1dac21ba2 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.551061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 279/555] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:10.560265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccc75d-4a24-4f5d-a0fc-676f87f9412c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.560585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccc75d-4a24-4f5d-a0fc-676f87f9412c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.560986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccc75d-4a24-4f5d-a0fc-676f87f9412c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.582077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7cccc75d-4a24-4f5d-a0fc-676f87f9412c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:10.583355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7cccc75d-4a24-4f5d-a0fc-676f87f9412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:10.592172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 280/556] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:10.592949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccc75d-4a24-4f5d-a0fc-676f87f9412c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.604794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 277/557] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:10 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/bf69b08068054c4180f2d44c9c07cb60/roles/a36d2857a03b44cc8c9eaad52457f4f3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:10.610515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccc75d-4a24-4f5d-a0fc-676f87f9412c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.643252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.721463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.722378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.722630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.722913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.746506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ee602-f5fc-4ab7-85a4-7e0d435c2eb7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.747061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:10.751983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.753115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.753635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.754206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.754456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:10.755745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 281/558] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:10.762362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.773249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:10.780566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c2da7-0bb5-4b1d-bd24-8b261d0dad18 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.783084 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:10.785019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 278/559] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:10.791459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.797646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.798329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.798613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.798914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.799985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.799985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.801587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.804170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d972be5-4813-43be-b278-2ccf50bd82cc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.809564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.810574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.811185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.811776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.812765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.813304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.815975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.818388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 282/560] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:10.826656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.828219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 279/561] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:10.834540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.836925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d971-daaf-40eb-877c-6ba0a4b7bc51 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.841803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.842695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.842912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.843163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.847568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e18a-653d-4bd5-a28e-844b45aad7bb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.854319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.854553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.855636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.856110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.856398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.856920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.870836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.872999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.874014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:10.878900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 283/562] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:10.881059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.891335 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699dd7-96c9-4783-8b18-52cb3efd834b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.897210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:10.898019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.898667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.898981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.899256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.900351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 280/563] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:10.903184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.903730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.905754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.906081 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.916133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2591b-0426-4b10-b16a-49f4e922ce8e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.921244 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.921951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 284/564] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:10.926092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.926419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.926703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.927501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:10.927808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.929400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.937472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.949197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6660ce-4256-4fbb-9f54-897adc24e9d4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:10.951702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 281/565] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:10.958656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:10.959474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:10.959751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:10.960024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:10.972585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:10.975017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:10.975860 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:10.991484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 31 04:26:10.995537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 285/566] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:11.002744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fffad-7eac-418b-96b9-fd79f58cd1ef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.004059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.011553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3fe57-6cfb-4d74-b1b5-4671a744244f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.012352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fe57-6cfb-4d74-b1b5-4671a744244f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.012630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fe57-6cfb-4d74-b1b5-4671a744244f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.012900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3fe57-6cfb-4d74-b1b5-4671a744244f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.023970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32557be5-abc7-488f-b56a-064eff8b16db admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.026549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3fe57-6cfb-4d74-b1b5-4671a744244f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.028606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3fe57-6cfb-4d74-b1b5-4671a744244f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.034161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336c12-af8c-4ffd-93ba-20a7582d56a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.035139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336c12-af8c-4ffd-93ba-20a7582d56a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.035618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336c12-af8c-4ffd-93ba-20a7582d56a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.036268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336c12-af8c-4ffd-93ba-20a7582d56a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.037422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336c12-af8c-4ffd-93ba-20a7582d56a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.037922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336c12-af8c-4ffd-93ba-20a7582d56a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.039986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336c12-af8c-4ffd-93ba-20a7582d56a4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.044194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e7a3fe57-6cfb-4d74-b1b5-4671a744244f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 31 04:26:11.045771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 282/567] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.047161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b03b2f-0a99-4768-8697-7164da4daa94 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.047445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b03b2f-0a99-4768-8697-7164da4daa94 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.047765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b03b2f-0a99-4768-8697-7164da4daa94 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.049768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 283/568] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:11.054454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b03b2f-0a99-4768-8697-7164da4daa94 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.066521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 286/569] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.068179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8283ac-4491-41cf-aa46-67f064f9dbbc None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.068593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8283ac-4491-41cf-aa46-67f064f9dbbc None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.069011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8283ac-4491-41cf-aa46-67f064f9dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.072696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b03b2f-0a99-4768-8697-7164da4daa94 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.077654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.078763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.078923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.079359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.080402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.080857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.082929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.094662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ad8283ac-4491-41cf-aa46-67f064f9dbbc None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:11.096217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ad8283ac-4491-41cf-aa46-67f064f9dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:11.105966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 284/570] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.106412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 287/571] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:11.110833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.113940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8283ac-4491-41cf-aa46-67f064f9dbbc None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.126080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bb289-198e-4088-b06b-65f4bdf9d907 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.126267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8283ac-4491-41cf-aa46-67f064f9dbbc None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.131364 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.132429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.132925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.133481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.141382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.142320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.142626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.143012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.147393 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.149444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.157357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.160122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.168626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:11.174437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 285/572] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.175586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.178010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:11.179453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 288/573] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.180288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.187858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c63dc-d81d-473d-b206-2cbc5641ce7e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.192242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc0666-6f47-4bf1-81cf-af1726f71394 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.194096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.195399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.195890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.196345 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.197386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.198239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.198665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.199246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.200465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.200924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.202866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.208238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:11.215898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:11.221173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 289/574] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.221173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.222275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 286/575] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.224074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.234557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758168e1-4038-46e2-8df9-83f0bc57ce80 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.234754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cab5e-4928-4dcd-a998-7969e67c2a89 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.239385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.240059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.240390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.240663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.241141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.241463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.241774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.242623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.243146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.244148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.244250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.252912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.255259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.260879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 290/576] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.261970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.270445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:11.276406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4e5dd-966b-4067-992c-23f4cf67c0c1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.276526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 287/577] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.276526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.283988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.284679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.284900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.285220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.285975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.286276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.287977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.292457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f091-e02e-4cf2-a9bc-f7981f46028d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.297324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.301914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 291/578] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.301914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.302958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.303415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.303830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.312189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.313309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2f00-2d3d-4890-a254-43e9ec6f1b0a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.314928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.318427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.319206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.319588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.319962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.320851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.321257 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.324741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.331812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:11.333608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 288/579] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.334650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.342290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 292/580] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.342290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.350301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029bfc-4896-4e3f-899e-42fe7efffbe3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.352847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88650b66-ede5-4fe8-8e76-0d1211fa3aa1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.355888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.357069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.357555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.357860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.358214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.358680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.359121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.359500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.360396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.360836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.363303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.370670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.372793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.377753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 293/581] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.378633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.390311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f3483-d9d0-46cd-a427-687873870448 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.392318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:11.398706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 289/582] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.399336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.400011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.400995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.401375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.401749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/72317f5c187c41e9b2d1c53c9cedcd1a/roles/a36d2857a03b44cc8c9eaad52457f4f3` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.410894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a6b0d-de37-4baf-8115-63f78d57279a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.415875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265f3f3-2604-4ebe-a2e1-2be4acca1da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.416957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f3f3-2604-4ebe-a2e1-2be4acca1da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.417375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f3f3-2604-4ebe-a2e1-2be4acca1da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.417851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265f3f3-2604-4ebe-a2e1-2be4acca1da6 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/7b6b83d1d42045bdad91bf814b54a7f6/roles/a36d2857a03b44cc8c9eaad52457f4f3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.419406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=72317f5c187c41e9b2d1c53c9cedcd1a, role_id=a36d2857a03b44cc8c9eaad52457f4f3)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.423191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.434415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265f3f3-2604-4ebe-a2e1-2be4acca1da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=7b6b83d1d42045bdad91bf814b54a7f6, role_id=a36d2857a03b44cc8c9eaad52457f4f3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.437260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265f3f3-2604-4ebe-a2e1-2be4acca1da6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.497915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 294/583] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:11 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/72317f5c187c41e9b2d1c53c9cedcd1a/roles/a36d2857a03b44cc8c9eaad52457f4f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:11.507025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.541782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 290/584] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:11 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/7b6b83d1d42045bdad91bf814b54a7f6/roles/a36d2857a03b44cc8c9eaad52457f4f3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:11.543494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d586d5e-a75c-4cc4-8237-d9720aacfbe9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.543787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d586d5e-a75c-4cc4-8237-d9720aacfbe9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.544065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d586d5e-a75c-4cc4-8237-d9720aacfbe9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.545957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 291/585] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:11.559643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e052f-8811-426d-b95d-bcea39011cc3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.559924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e052f-8811-426d-b95d-bcea39011cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.560202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e052f-8811-426d-b95d-bcea39011cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.586556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d660fd-3c38-4ab1-b4a3-030115b1378d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.600133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ce5e052f-8811-426d-b95d-bcea39011cc3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:11.601400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ce5e052f-8811-426d-b95d-bcea39011cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:11.716136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 292/586] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:11.723561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.724609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.725106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.725618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.726552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.727075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.729937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.742544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 295/587] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.744711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e052f-8811-426d-b95d-bcea39011cc3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.748437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.758257 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913cce4-a551-4b27-8158-d5e851752089 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.758857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e052f-8811-426d-b95d-bcea39011cc3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.765832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.766613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.766915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.767190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.768514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.769535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.770002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.770459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.775173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.777184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.782987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:11.790052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:11.792865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 31 04:26:11.793218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 293/588] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.794216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 296/589] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:11.798984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.799644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.809452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8c0b-8a6a-4eab-8f49-01cb12c08a55 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.810234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4f6c8-6c82-42ab-8090-d0013debe49f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.814506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.815278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.815560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.815831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.816322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.816586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.816882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.817575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.818039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.818483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.818700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.819774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.820267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.822944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.829199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 294/590] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.834482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.842342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 297/591] 10.222.0.21 () {56 vars in 1160 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:11.846851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1114903-a5ac-4312-9e36-4d4bcf0c61b2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.847970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.848863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.849742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.850020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.850289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.859215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4f67-b017-4eba-b02c-2fd169be4792 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.861883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.863942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.864426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.865421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.865885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.866337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.878374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.880593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.882222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:11.883761 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 295/592] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:11.889839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.899803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759dd3a-a392-4c48-a286-9651d5fe068c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.900204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:11.901607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 298/593] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.904264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.904897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.905173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.905441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.906167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.906468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.907656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.908356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.918215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc7a92-86b1-49fd-99f6-a9561e0f8448 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.920701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 296/594] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:11.923323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.924236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.924725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.925214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.925917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.926451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.927037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.928989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.936197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62451bd-62da-4d82-aa62-e4b16cbc98e7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.941277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.942103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.942381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.942706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.944548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 299/595] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:11.952016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.952174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.954439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.964627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32b724-0449-47a7-b1ab-df210190dfe2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.969024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 31 04:26:11.969842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.970504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 297/596] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:11.971128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.971654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.972114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.975780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:11.980820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.983159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:11.985544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10442-f522-45b7-a35e-24f1c7388212 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:11.989916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:11.990565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:11.990867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:11.991140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:11.992397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:11.992851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:11.995873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.001179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:12.002958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 300/597] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:12.015097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 298/598] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Jan 31 04:26:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:12.016107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.020457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.031276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e28874-b42d-4f2d-bff2-544beb2bc170 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.033025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728e299-86e8-49e6-9586-616a0096053c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.039507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.040765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.041078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.041404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.045063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.045972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.046445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.046949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.047967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:12.048463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.050577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.050760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.058974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.063707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 299/599] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:26:12.074835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.077534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 301/600] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:12.083447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.084196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6bd3-df32-4332-b961-1fa88fd23590 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.098498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842f89c-473c-42a3-9b89-6aaa29bf8372 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.098764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.099668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.099932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.100244 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.104673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.105921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.106401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.106926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/889a6422677047b6a75d1480f156ead7/roles/a36d2857a03b44cc8c9eaad52457f4f3` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.115181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.118010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.125066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=889a6422677047b6a75d1480f156ead7, role_id=a36d2857a03b44cc8c9eaad52457f4f3)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.128055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.139880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:12.145872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 300/601] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:12.147264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.157795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90416b-b77b-422e-9ceb-58979d40268a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.162474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.163291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.163719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.164134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.165005 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:12.165592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.167340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.179388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 301/602] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:12.188944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.199703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042b6a9-ae69-4cb8-a23c-a5ec72f74a3b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.204748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.205731 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.206179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.206591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.217901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 302/603] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:12 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/889a6422677047b6a75d1480f156ead7/roles/a36d2857a03b44cc8c9eaad52457f4f3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:26:12.221160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.223573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.239578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:12.241398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 302/604] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:12.247703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.320199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c16ab-3e40-4716-8ef6-f86b58e89a5e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.325374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f6e43-d9a2-428a-94af-5e44eeac3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.326201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6e43-d9a2-428a-94af-5e44eeac3b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.326642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6e43-d9a2-428a-94af-5e44eeac3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.327110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f6e43-d9a2-428a-94af-5e44eeac3b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.328091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f6e43-d9a2-428a-94af-5e44eeac3b93 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:12.328581 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f6e43-d9a2-428a-94af-5e44eeac3b93 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.330545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f6e43-d9a2-428a-94af-5e44eeac3b93 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.355218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 303/605] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:12.360830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:12.371373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f2d1-27ba-44e7-b6ec-b5a374c82fbc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:12.380226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542e9f4-4846-4e24-9473-82a7babb4b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:12.381122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542e9f4-4846-4e24-9473-82a7babb4b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:12.381555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542e9f4-4846-4e24-9473-82a7babb4b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:12.381979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542e9f4-4846-4e24-9473-82a7babb4b23 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:12.382983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542e9f4-4846-4e24-9473-82a7babb4b23 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=77321e9c7ec34370b1b8246dde35911b) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:12.383449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542e9f4-4846-4e24-9473-82a7babb4b23 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:12.386276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542e9f4-4846-4e24-9473-82a7babb4b23 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:12.393070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 303/606] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:12 2022] GET /identity/v3/role_assignments?user.id=77321e9c7ec34370b1b8246dde35911b&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:13.472314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f161-b1fe-4b4e-876e-5daaa50b5127 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.473325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f161-b1fe-4b4e-876e-5daaa50b5127 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.473803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f161-b1fe-4b4e-876e-5daaa50b5127 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.476037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 304/607] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:13.481720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3daa91-aca3-4d38-93f4-4c4b323bc018 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.482547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3daa91-aca3-4d38-93f4-4c4b323bc018 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.483043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3daa91-aca3-4d38-93f4-4c4b323bc018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.502569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fe3daa91-aca3-4d38-93f4-4c4b323bc018 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:13.504136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fe3daa91-aca3-4d38-93f4-4c4b323bc018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:13.512458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 304/608] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:13.536586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f161-b1fe-4b4e-876e-5daaa50b5127 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.551025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f161-b1fe-4b4e-876e-5daaa50b5127 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.555596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.562167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.562687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.563193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.576857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:13.584066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:13.585468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 305/609] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:13.592399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3daa91-aca3-4d38-93f4-4c4b323bc018 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.607095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3daa91-aca3-4d38-93f4-4c4b323bc018 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.611924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.612803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.613363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.613839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.614816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:13.615323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:13.617094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:13.627814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 305/610] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:13.632824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.647759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e8cbb-215b-4e46-b435-89b36d099022 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.653140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.654135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.654625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.655111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.670000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:13.672110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:13.694813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:13.696759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 306/611] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:13.702498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.713071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6facc-3da5-4dec-93fb-249f9aae7d6d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.717763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.718640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.723259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.723744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.724787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:13.725339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:13.727268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:13.744911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 306/612] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:13.749973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.761593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2b43-a893-4efb-9002-c63ceb6ca087 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.766273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.767306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.767802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.768273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.780261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:13.783130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:13.804024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:13.806280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 307/613] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:13.812032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.829122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7ff0-6185-44ce-8017-50d6c99a3555 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.838874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.839544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.839825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.840102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.840957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:13.841264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:13.843138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:13.870583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 307/614] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:13.875629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.889671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d8f0-5d5e-4011-afdb-456ed51690c9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.895805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.896470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.897138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.897421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.910823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:13.912648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:13.926661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 308/615] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:13.932204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:13.944144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a72f6-76c1-4f65-8c90-a2039e085716 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:13.949282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:13.950045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:13.950326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:13.950596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:13.968901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:13.970724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:13.993187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:13.994915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 308/616] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:14.000304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.013091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62455-3c54-4cba-a338-a65e4d2f1c6e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.017845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.018498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.018772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.019063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.019793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.020093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.021671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.037499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 309/617] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:14.043342 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.055657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dd29a-594e-4742-8494-c9386cacf8e5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.063494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.064416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.064697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.064967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.073456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.075483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.101124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:14.102855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 309/618] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:14.108746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.120182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870e0c-5de3-4ab9-8637-58eba53dab77 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.127029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc9c23-2df9-49c7-93c8-02ac867aa4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.127693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9c23-2df9-49c7-93c8-02ac867aa4dd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.127976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9c23-2df9-49c7-93c8-02ac867aa4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.128252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9c23-2df9-49c7-93c8-02ac867aa4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.129059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc9c23-2df9-49c7-93c8-02ac867aa4dd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.129363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc9c23-2df9-49c7-93c8-02ac867aa4dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.131261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc9c23-2df9-49c7-93c8-02ac867aa4dd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.150161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 310/619] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:14.155896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.169887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d4eae-249c-4259-8794-a3796753cffe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.175907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45aeb0-5bf6-4e7f-8ea9-368c94c365e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.176538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45aeb0-5bf6-4e7f-8ea9-368c94c365e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.176818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45aeb0-5bf6-4e7f-8ea9-368c94c365e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.177089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45aeb0-5bf6-4e7f-8ea9-368c94c365e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.177921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45aeb0-5bf6-4e7f-8ea9-368c94c365e2 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=bf69b08068054c4180f2d44c9c07cb60) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.178225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45aeb0-5bf6-4e7f-8ea9-368c94c365e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.180074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45aeb0-5bf6-4e7f-8ea9-368c94c365e2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.191333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 310/620] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/role_assignments?user.id=bf69b08068054c4180f2d44c9c07cb60&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:14.389978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7290-e57a-44e7-8287-125cab7d5395 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.390312 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7290-e57a-44e7-8287-125cab7d5395 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.390482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd7290-e57a-44e7-8287-125cab7d5395 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.392646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 311/621] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:14.399150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab89fc-c5b5-4268-b9a8-f3c74e5c2b9b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.399436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab89fc-c5b5-4268-b9a8-f3c74e5c2b9b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.400271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab89fc-c5b5-4268-b9a8-f3c74e5c2b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.419994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f206-84d0-4fcc-af18-10928108245b None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.420302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f206-84d0-4fcc-af18-10928108245b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.420554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127f206-84d0-4fcc-af18-10928108245b None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.422620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 312/622] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:14.426610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6dab89fc-c5b5-4268-b9a8-f3c74e5c2b9b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:14.427608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f2af-792d-4bfe-ad44-ed4fa3745a85 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.427891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f2af-792d-4bfe-ad44-ed4fa3745a85 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.428165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f2af-792d-4bfe-ad44-ed4fa3745a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.428666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6dab89fc-c5b5-4268-b9a8-f3c74e5c2b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:14.441800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 311/623] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:14.456475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f423f2af-792d-4bfe-ad44-ed4fa3745a85 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:14.457671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f423f2af-792d-4bfe-ad44-ed4fa3745a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:14.464500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab89fc-c5b5-4268-b9a8-f3c74e5c2b9b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.465628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 313/624] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:14.475064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab89fc-c5b5-4268-b9a8-f3c74e5c2b9b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.479742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.480516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.480791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.481056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.490526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423f2af-792d-4bfe-ad44-ed4fa3745a85 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.492997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:14.500232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423f2af-792d-4bfe-ad44-ed4fa3745a85 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.500727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:14.504816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.505698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.506071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.506425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.506585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 312/625] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:14.507791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.519524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757f5f3-317b-4363-9791-9c9f03981da7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.520340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:14.524199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.525558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.525925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.526107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.526942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.527245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.528622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:14.528937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.530295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 314/626] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:14.537512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.540191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 313/627] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:14.558878 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.559092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a763-89b9-4691-9bd2-08d2595c09c5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.559092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.559092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.559092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.559840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.559984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f282a-7024-4fcd-9c94-c5107a6cc794 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.560130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.560130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.560130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.560652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.560832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.560979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.561304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.572647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.574568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.576327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 315/628] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:14.581185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.591946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c8ee7-d714-4174-b9bf-b8d450d96444 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.592662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:14.596664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.597436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.597759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.598029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.598457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 314/629] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:14.599799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.610242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b95b79-cc62-49f6-94a9-b922673e0a1c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.610569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.613204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.614768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.615438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.615719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.615996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.616731 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.617034 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.619103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.630867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 315/630] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:14.631980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:14.633447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 316/631] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:14.637114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.639476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.647640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23df9-3527-44e0-8462-4604be35df8d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.650418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e79f0-1abf-4709-b032-ea3ad0b1e59c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.652831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.653788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.654167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.654480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.657116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.657949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.658468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.659000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.659951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.660435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.662342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.664127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.667805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.678342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 317/632] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:14.682837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 31 04:26:14.687118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 316/633] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:14.688319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.688597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.700536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dee466-0f44-4b23-8f70-3e4123f7a08e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.703664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf29cd-df72-490d-8d31-2442e355650d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.705114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.705889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.706206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.706496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.707442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.707745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.709766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.719018 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.719815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.720096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.720365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.732533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.734877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.735159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 317/634] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:14.740973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.754393 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76fb9-1608-43d2-abeb-0acc7baff5d7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.760213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.762012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.762012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.762012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.763591 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 31 04:26:14.765457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 318/635] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:14.771812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.772380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.773563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.783837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e04c75-0443-4fca-b7e6-b314ec3d73c0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.784918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 318/636] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:14.788840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.789692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.790027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.791222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.792159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.792777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.793216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.795266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.802067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee087-1848-49dd-966c-497bd946b206 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.807008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.807777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.808052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.808321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.817033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 319/637] 10.222.0.21 () {56 vars in 1158 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:14.823997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.831681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.833510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.836436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2bb8f-d008-4c27-9acc-06c58e5cc644 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.842809 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.843620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.843996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.844816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.854959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.856951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.859629 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:14.866956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 320/638] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:14.867168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 319/639] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:14.872698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.880540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.883641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5ea33-da67-4dea-88f9-b2463f2f6ff1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.890193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.891093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.891489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.892158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.893154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:14.893579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.895462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.902541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81107-7c86-4af8-86be-646dc01b5a12 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.911374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 321/640] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:14.920308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.922954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.924180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.926429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.926910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.945444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.947944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.949010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f2741-58fa-4d44-b367-254381765921 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:14.967029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:14.967437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:14.968225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:14.968504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:14.968770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:14.969140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 320/641] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:14.975333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:14.976478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:14.978653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:14.992343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:14.994401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 322/642] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:14.994749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39fd2-a4e5-4dd5-a6d6-6183a9173a6b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.001599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.006366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.008792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.009834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.010306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.011240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.012658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.015534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.021508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143e3d1-71bd-4d78-90b1-8891b58ad99a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.034571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 321/643] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:15.035475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.036393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.036850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.037290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.038306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.038847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.041684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.047614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.051965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9ee15-0417-494d-9e58-82b85e766549 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.056969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.058125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.058616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.059163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.066608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.068882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.069000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 323/644] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.075238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.095095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:15.096478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b163bc-8200-4d87-8201-f96bf7b4538d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.097201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 322/645] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:15.102163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.107958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.108861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.109372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.110372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.111436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=7b6b83d1d42045bdad91bf814b54a7f6) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.112553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.116953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.121117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818a9f-31a5-4116-abe4-275a53216f27 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.129735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69550e8b-9348-4f3d-b79d-8f1bebfd8741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.131176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69550e8b-9348-4f3d-b79d-8f1bebfd8741 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.132028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 324/646] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/role_assignments?user.id=7b6b83d1d42045bdad91bf814b54a7f6&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.132530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69550e8b-9348-4f3d-b79d-8f1bebfd8741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.133080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69550e8b-9348-4f3d-b79d-8f1bebfd8741 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.134692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69550e8b-9348-4f3d-b79d-8f1bebfd8741 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.135219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69550e8b-9348-4f3d-b79d-8f1bebfd8741 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.137386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69550e8b-9348-4f3d-b79d-8f1bebfd8741 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.151136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 323/647] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:15.158981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.174391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1be363-9918-44fe-9189-6e6a1c0dc6cc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.189115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10f7e0-4cfc-47af-9bea-620bfcd0b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.189780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f7e0-4cfc-47af-9bea-620bfcd0b8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.190059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f7e0-4cfc-47af-9bea-620bfcd0b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.190332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f7e0-4cfc-47af-9bea-620bfcd0b8a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.191238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f7e0-4cfc-47af-9bea-620bfcd0b8a0 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=72317f5c187c41e9b2d1c53c9cedcd1a) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.191546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f7e0-4cfc-47af-9bea-620bfcd0b8a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.194830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f7e0-4cfc-47af-9bea-620bfcd0b8a0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.208535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4d93-399e-445a-8b6e-402f583a8a02 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.208874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4d93-399e-445a-8b6e-402f583a8a02 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.209080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4d93-399e-445a-8b6e-402f583a8a02 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.210996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 324/648] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:15.213965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 325/649] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/role_assignments?user.id=72317f5c187c41e9b2d1c53c9cedcd1a&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:15.218203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e669aa-8685-4fff-8392-d7dc0d864427 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.218636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e669aa-8685-4fff-8392-d7dc0d864427 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.219044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e669aa-8685-4fff-8392-d7dc0d864427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.235411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eec7e6-41bf-4f56-8b7f-c833eccd4505 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.237869 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eec7e6-41bf-4f56-8b7f-c833eccd4505 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.245140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eec7e6-41bf-4f56-8b7f-c833eccd4505 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.247504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 326/650] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:15.257596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a2e669aa-8685-4fff-8392-d7dc0d864427 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:15.259130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a2e669aa-8685-4fff-8392-d7dc0d864427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:15.263033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d133b9-7c71-4d55-afd1-c71ccaa14074 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.263475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d133b9-7c71-4d55-afd1-c71ccaa14074 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.263961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d133b9-7c71-4d55-afd1-c71ccaa14074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.285842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 325/651] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:15.288099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-73d133b9-7c71-4d55-afd1-c71ccaa14074 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:15.289553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-73d133b9-7c71-4d55-afd1-c71ccaa14074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:15.310020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e669aa-8685-4fff-8392-d7dc0d864427 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.313403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 327/652] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:15.322411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e669aa-8685-4fff-8392-d7dc0d864427 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.337459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.338504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.338917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.339291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.365078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d133b9-7c71-4d55-afd1-c71ccaa14074 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.373686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:15.377520 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d133b9-7c71-4d55-afd1-c71ccaa14074 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.381729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:15.382419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 326/653] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:15.388357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.392676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.393715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.394136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.394588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.399553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10582435-c1cd-4c75-99ef-60d45180e9b7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.406165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.408041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.408041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.408041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.408933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.409405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.410554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:15.411259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.418650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:15.420292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 328/654] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:15.424731 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 327/655] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:15.426869 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.430055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.440462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283bbd-d167-4c64-88ef-a46328afd7d4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.440880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cebbc5-9975-43ba-8a51-0ee3f2fdf2ae admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.444983 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.445396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.445797 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.446145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.446383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.446583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.446941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.447131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.447595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.448071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.449820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.459184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.461207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.463745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 329/656] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.468967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.480247 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce7c11-8245-4b67-b8c8-3885165a37f5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.483385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:15.484875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.485000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 328/657] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:15.485462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.485827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.486066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.490488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.498298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.500178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.503461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075b9d0-f5cb-4fe9-998e-b5bc01bb5ce9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.510764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.513317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.513527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.513799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.514538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.515471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.516483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.518452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:15.520672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 330/658] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:15.527103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.530869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 329/659] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.536794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.547364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908751ec-f9e9-4e9e-98db-7c6386903ce2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.547364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.547364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.547364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.547690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9a976-bc78-4df3-b872-7d44fd5a1c68 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.547759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.548112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.548429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.550041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.554402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.555341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.555734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.556097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.564828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 331/660] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.565617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.567845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.570350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.582879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e26360-fd15-48fc-b309-3a844cf34d3e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.585173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 31 04:26:15.588090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.588877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.589153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.589422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.591016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 330/661] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:15.593556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.597975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.600916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.604138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bf6f7-0ea3-4f2d-a6a7-688d118fd691 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.609371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.610150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.610576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.610988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.612037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.612480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.614514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.616901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 31 04:26:15.619115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 332/662] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:15.625019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.637505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 331/663] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.638397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727261d0-84d3-40bd-9fbe-3a2d9f60bf94 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.642983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.643433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.644330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.644743 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.645147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.646157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.646644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.648957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.655377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189fe58-bf14-4479-9a7c-acad52b3cabf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.661789 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.662620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.663028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.663402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.671953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 333/664] 10.222.0.21 () {56 vars in 1160 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:15.677380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.679752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.682404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.689572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a846ea-55a6-4752-9aa4-c664f3e46e6f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.694115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.694732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.695039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.695309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.703758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.705494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.706823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:15.713452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 332/665] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:15.715510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.719381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 334/666] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:26:15.724518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.726691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80f129-5b74-4896-93f0-8f42cfa136d5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.733022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.733942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.734426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9c56b-38ba-403d-82d1-a3b4bbbe5280 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.734654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.735143 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.736071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.736679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.738637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.739452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.740276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.740550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.740818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.752744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.753928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 333/667] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.758299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.759791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.769956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54ca1-f36b-44b3-be41-07d10f327b5d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.776218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.777194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.777619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.778033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.786080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.787795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:15.788461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.794821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 335/668] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:15.795228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.804910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3ab5b-a5f7-4481-a89a-7c0b02123cd4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.810450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.811167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.811442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.811767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.812540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.812892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.814536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.815027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:15.821723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 334/669] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:15.823234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.834208 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4847a9-5c09-4fad-a054-aa0b2765e083 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.836292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 336/670] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:15.840139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.841152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.841581 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.842012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.842423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.843299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.843847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.845884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.853252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02074d-acf9-4c02-8d0d-9782eccfd293 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.864503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.865293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.867850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 335/671] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:15.868793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.869156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.875233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.885668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.888921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.891123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a6759-2e68-49a1-93a8-da19960c0684 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.902336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62017c6-5a43-43e2-bb87-2585c17d4867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.904905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62017c6-5a43-43e2-bb87-2585c17d4867 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.905129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62017c6-5a43-43e2-bb87-2585c17d4867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.905471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62017c6-5a43-43e2-bb87-2585c17d4867 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/77321e9c7ec34370b1b8246dde35911b/roles/a36d2857a03b44cc8c9eaad52457f4f3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.921243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:15.925393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 337/672] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:15.932096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.938929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62017c6-5a43-43e2-bb87-2585c17d4867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=77321e9c7ec34370b1b8246dde35911b, role_id=a36d2857a03b44cc8c9eaad52457f4f3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.941729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0708bf-679b-4c54-a6d1-3e227944bad4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.941913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62017c6-5a43-43e2-bb87-2585c17d4867 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.952427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.953116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.953396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.953668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.954469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.954774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.956722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:15.970172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 338/673] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:15.975740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:15.985456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fce960-8404-43e1-94a9-12b4c216f949 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:15.990121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9adab4-79be-4d1f-a3b8-c578a2bb0f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:15.990931 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9adab4-79be-4d1f-a3b8-c578a2bb0f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:15.991279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9adab4-79be-4d1f-a3b8-c578a2bb0f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:15.991670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9adab4-79be-4d1f-a3b8-c578a2bb0f79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:15.992676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9adab4-79be-4d1f-a3b8-c578a2bb0f79 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=889a6422677047b6a75d1480f156ead7) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:15.993080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9adab4-79be-4d1f-a3b8-c578a2bb0f79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:15.995940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9adab4-79be-4d1f-a3b8-c578a2bb0f79 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:16.002554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 339/674] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:15 2022] GET /identity/v3/role_assignments?user.id=889a6422677047b6a75d1480f156ead7&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:16.049603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 336/675] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:15 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/77321e9c7ec34370b1b8246dde35911b/roles/a36d2857a03b44cc8c9eaad52457f4f3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:17.010207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d333fa-3835-4fd7-96de-5cba9a236e44 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.010944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d333fa-3835-4fd7-96de-5cba9a236e44 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.010944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d333fa-3835-4fd7-96de-5cba9a236e44 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.012731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 340/676] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:17.018106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e872c-0f3a-4385-bc2a-a0b2a795a59a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.018571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e872c-0f3a-4385-bc2a-a0b2a795a59a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.018722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e872c-0f3a-4385-bc2a-a0b2a795a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.043033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d91e872c-0f3a-4385-bc2a-a0b2a795a59a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:17.044236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d91e872c-0f3a-4385-bc2a-a0b2a795a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:17.130592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 337/677] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:17.169972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d333fa-3835-4fd7-96de-5cba9a236e44 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.185040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d333fa-3835-4fd7-96de-5cba9a236e44 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.189362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.190133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.190415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.190690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.210640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:17.218077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:17.219630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 341/678] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:17.224899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e872c-0f3a-4385-bc2a-a0b2a795a59a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.234397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e872c-0f3a-4385-bc2a-a0b2a795a59a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.238972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.239655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.239940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.240220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.240989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:17.241321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.242937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.258340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 338/679] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:17.263965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.280150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd996-c8e3-4763-9708-d90475f276f8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.284930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.285712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.285993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.286265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.300078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.301843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.324940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:17.326115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 342/680] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:17.331693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.343711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b495c4-33b4-4004-a9be-23f1a78c5b80 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.348303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.348944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.349270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.349601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.350337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:17.350641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.352352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.370871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 339/681] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:17.376017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.386372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaaf1a8-9a1d-4628-8b54-1fe58146979c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.390968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.391793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.392072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.392346 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.405985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.408394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.426495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:17.428041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 343/682] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:17.433712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.445208 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c2e3-3f1b-4aec-aa0f-0e86c3330e37 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.449841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.450561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.450873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.451153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.452091 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:17.452401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.454367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.479932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 340/683] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:17.484943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.496978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764db8a2-44b8-4bee-a21c-6e209a7097cd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.501629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.502321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.502606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.502905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.514558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.516345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.528885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 344/684] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:17.534714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.546884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc41310-c0df-4e9f-a789-e81e2dc6e4d2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.551913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.552791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.553243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.553408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.568232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.570140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.589036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:17.590538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 341/685] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:17.595850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.608124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316172c6-3c47-42e8-9993-71dd2d4787ad admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.612846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.613606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.613948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.614298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.619243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:17.619640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.621372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.634694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 345/686] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:17.639625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.650979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd8606-0a2c-40e0-833c-7c68af2f76c9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.655655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.656479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.657012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.657296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.668845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.670888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.686460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:17.687725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 342/687] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:17.693500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.708132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fceed0-a3c3-4c1d-9d30-fdbcf4b8845d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.713152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39ae3d-8ea3-4cd5-8aff-6822177aa70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.713865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ae3d-8ea3-4cd5-8aff-6822177aa70f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.714146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ae3d-8ea3-4cd5-8aff-6822177aa70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.714420 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ae3d-8ea3-4cd5-8aff-6822177aa70f admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.715400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39ae3d-8ea3-4cd5-8aff-6822177aa70f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:17.726821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39ae3d-8ea3-4cd5-8aff-6822177aa70f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.726821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39ae3d-8ea3-4cd5-8aff-6822177aa70f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.749154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 346/688] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:17.755163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:17.768563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3a719-d72f-4266-a913-59f56853dea4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:17.784633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1401f5-5cd2-4d1f-99b0-a28cfc96a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:17.785451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1401f5-5cd2-4d1f-99b0-a28cfc96a7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:17.785834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1401f5-5cd2-4d1f-99b0-a28cfc96a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:17.786209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1401f5-5cd2-4d1f-99b0-a28cfc96a7a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:17.787198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1401f5-5cd2-4d1f-99b0-a28cfc96a7a7 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=bf69b08068054c4180f2d44c9c07cb60) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:17.787613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1401f5-5cd2-4d1f-99b0-a28cfc96a7a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:17.789574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1401f5-5cd2-4d1f-99b0-a28cfc96a7a7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:17.800852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 343/689] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:17 2022] GET /identity/v3/role_assignments?user.id=bf69b08068054c4180f2d44c9c07cb60&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:18.172382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5dd0a-099f-463e-bd56-90ccb767149f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.173217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5dd0a-099f-463e-bd56-90ccb767149f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.173636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5dd0a-099f-463e-bd56-90ccb767149f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.175835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 347/690] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:18.181657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24b469-20d2-4b1a-a140-b2b5f7167d3b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.182114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24b469-20d2-4b1a-a140-b2b5f7167d3b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.182403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24b469-20d2-4b1a-a140-b2b5f7167d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.206908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ae24b469-20d2-4b1a-a140-b2b5f7167d3b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:18.208112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ae24b469-20d2-4b1a-a140-b2b5f7167d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:18.216751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 344/691] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:18.263839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5dd0a-099f-463e-bd56-90ccb767149f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.280765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5dd0a-099f-463e-bd56-90ccb767149f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.288408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.289460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.289998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.290498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.291418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:18.292645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:18.292645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:26:18.292645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:26:18.293889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:18.310260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 31 04:26:18.311777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 348/692] 10.222.0.21 () {56 vars in 1150 bytes} [Mon Jan 31 04:26:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:18.317580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24b469-20d2-4b1a-a140-b2b5f7167d3b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.327329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24b469-20d2-4b1a-a140-b2b5f7167d3b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.343561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.344171 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.344451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.344723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.345463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:18.345766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:18.346813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:18.346813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:26:18.346813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:26:18.347717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba4b13-a2bb-4e51-acc0-b79781e20fb9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:18.353659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 345/693] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Jan 31 04:26:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:18.358771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.372083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922bed8-75da-4ded-b547-6da16259f9d8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.382406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.383325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.384374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.385159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.386092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:18.386593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:18.387827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:18.387827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:26:18.387827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:26:18.389066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efac91-30f3-4e92-9330-b6a61347d9c0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:18.395414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 349/694] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Jan 31 04:26:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:18.421050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28dbe-5925-45d9-962c-eaa64a0f8788 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.421365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28dbe-5925-45d9-962c-eaa64a0f8788 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.421608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a28dbe-5925-45d9-962c-eaa64a0f8788 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.423828 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 346/695] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:18.429600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f4cc-7169-46c7-ac12-bb88deed0cba None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.430244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f4cc-7169-46c7-ac12-bb88deed0cba None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.430938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f4cc-7169-46c7-ac12-bb88deed0cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.471133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-dc77f4cc-7169-46c7-ac12-bb88deed0cba None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:18.472758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dc77f4cc-7169-46c7-ac12-bb88deed0cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:18.485184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 350/696] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:18.511044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a28dbe-5925-45d9-962c-eaa64a0f8788 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.535692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a28dbe-5925-45d9-962c-eaa64a0f8788 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.541448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.550690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.550690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.550690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.558401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:18.560296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:18.586150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:18.588562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 347/697] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:18.594290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f4cc-7169-46c7-ac12-bb88deed0cba None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.608884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f4cc-7169-46c7-ac12-bb88deed0cba None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.614145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fc73f-3ea1-4f6d-9279-0973fd50dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.615891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc73f-3ea1-4f6d-9279-0973fd50dd9d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.616399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc73f-3ea1-4f6d-9279-0973fd50dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.616891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fc73f-3ea1-4f6d-9279-0973fd50dd9d admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.617823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fc73f-3ea1-4f6d-9279-0973fd50dd9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:18.618523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fc73f-3ea1-4f6d-9279-0973fd50dd9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:18.620576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fc73f-3ea1-4f6d-9279-0973fd50dd9d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:18.637748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 351/698] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:18.643466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.653573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611270a-8b13-43f7-bdf7-78f742f5e454 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.661838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6cbd7-d7b4-40f9-b5a5-a15b74d589e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.662928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6cbd7-d7b4-40f9-b5a5-a15b74d589e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.663420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6cbd7-d7b4-40f9-b5a5-a15b74d589e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.663942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6cbd7-d7b4-40f9-b5a5-a15b74d589e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.664872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6cbd7-d7b4-40f9-b5a5-a15b74d589e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:18.667353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6cbd7-d7b4-40f9-b5a5-a15b74d589e3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:18.752194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 348/699] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:26:18 2022] POST /identity/v3/users => generated 254 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:18.824848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126e503-5e0b-48bb-ac06-bb3bface9222 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.825169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126e503-5e0b-48bb-ac06-bb3bface9222 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.825408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126e503-5e0b-48bb-ac06-bb3bface9222 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.827539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 352/700] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:18.832941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31819f-eb79-4f30-9c26-b7c455d042ca None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.833512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31819f-eb79-4f30-9c26-b7c455d042ca None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.834001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31819f-eb79-4f30-9c26-b7c455d042ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.857982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ca31819f-eb79-4f30-9c26-b7c455d042ca None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:18.859559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ca31819f-eb79-4f30-9c26-b7c455d042ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:18.874599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 349/701] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:18.910067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126e503-5e0b-48bb-ac06-bb3bface9222 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.929234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126e503-5e0b-48bb-ac06-bb3bface9222 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.937556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.938349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.938627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.938919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.958123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:18.965965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:18.967493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 353/702] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:18.973221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31819f-eb79-4f30-9c26-b7c455d042ca None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:18.982524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31819f-eb79-4f30-9c26-b7c455d042ca None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:18.989517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44a396-fc5a-4540-bd60-9544f4dd72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:18.990182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a396-fc5a-4540-bd60-9544f4dd72c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:18.990461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a396-fc5a-4540-bd60-9544f4dd72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:18.990739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a396-fc5a-4540-bd60-9544f4dd72c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:18.991538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a396-fc5a-4540-bd60-9544f4dd72c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:18.991839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a396-fc5a-4540-bd60-9544f4dd72c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:18.994170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44a396-fc5a-4540-bd60-9544f4dd72c3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.006294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 350/703] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:19.011934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.028806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6dab4-d34e-42d2-a93e-b62383b98d62 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.036829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.039016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0138d28-d24d-4155-8f75-391fdc8a6523 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.039283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0138d28-d24d-4155-8f75-391fdc8a6523 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.039569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0138d28-d24d-4155-8f75-391fdc8a6523 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.041665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 351/704] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:19.042080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.042357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.042631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.047357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2a4d-4dad-4dd9-8725-c37dc4ba1c41 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.047643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2a4d-4dad-4dd9-8725-c37dc4ba1c41 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.047919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e2a4d-4dad-4dd9-8725-c37dc4ba1c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.057106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.059091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.078161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:19.081946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 354/705] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:19.082149 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5c4e2a4d-4dad-4dd9-8725-c37dc4ba1c41 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:19.082149 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5c4e2a4d-4dad-4dd9-8725-c37dc4ba1c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:19.090153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.103862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 352/706] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:19.112443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4018d-a323-4eaa-8d58-0d0ac599bf3a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.119620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.120340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.120622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.120905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.121739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:19.122044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.123827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.128447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e2a4d-4dad-4dd9-8725-c37dc4ba1c41 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.138428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e2a4d-4dad-4dd9-8725-c37dc4ba1c41 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.141508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 355/707] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:19.146823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.147547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.150137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.150600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.151029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.151705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.152730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:19.152730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:26:19.152730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:26:19.153609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.161078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84f8be-79d0-4c78-ba62-00a025f43c58 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.166238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.167163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.167546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.167827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.168049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 31 04:26:19.169524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 353/708] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:19.175352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.177488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.179625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.185798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972ff8b-8fbe-4125-bf59-9ccf096b3663 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.191363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.192452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.192923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.193379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.195344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:19.195653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.196787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 31 04:26:19.197888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.198450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 356/709] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:19.204329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.206906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 354/710] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:19.212301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.215664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8469-e3f4-477f-a5ed-0d0c7de769c3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.221891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.222549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.222724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e0fa-aea9-4fee-955c-87869c7095b6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.222936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.223163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.224291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:19.224749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.227269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.228004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.228613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.228893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.229160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.229861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:19.230159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.231743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.244887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 355/711] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:19.254512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 357/712] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:19.261125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.272147 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93fa81-0628-4f9d-a93f-174538b0336f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.277158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.277877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.278160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.278441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.289488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.291919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.303707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 356/713] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:26:19.309682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.328491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86acc84-370b-4579-a983-f9adf19ee1fa admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.333123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.333922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.334198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.334471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.347928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.349819 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.369646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:19.371235 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 358/714] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:19.376697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.387629 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ed00-387f-4893-b40d-b116335c9973 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.394148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.394837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.395124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.395397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.396145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:19.396447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.398155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.416590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 357/715] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:19.422328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.436508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381456f-a882-4d38-987a-09738dd9f2fc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.447851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.448701 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.448979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.449251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.459506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.461557 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.477202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:19.479648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 359/716] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:19.485135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.496700 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21961536-fe98-4d7f-a336-92aeeec3c709 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.511447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ff484-5b5d-4ebe-923c-ecd1b0004b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.512226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff484-5b5d-4ebe-923c-ecd1b0004b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.512507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff484-5b5d-4ebe-923c-ecd1b0004b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.512775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ff484-5b5d-4ebe-923c-ecd1b0004b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.513635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ff484-5b5d-4ebe-923c-ecd1b0004b47 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:19.513939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ff484-5b5d-4ebe-923c-ecd1b0004b47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.515876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ff484-5b5d-4ebe-923c-ecd1b0004b47 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.535011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 358/717] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:19.541672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:19.557005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7beb4e-9189-4bcd-86f2-438f40e6b256 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:19.571469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ecbf5-1006-405c-8730-0a9b8d69d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:19.572120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecbf5-1006-405c-8730-0a9b8d69d107 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:19.572398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecbf5-1006-405c-8730-0a9b8d69d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:19.572669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecbf5-1006-405c-8730-0a9b8d69d107 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:19.573510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ecbf5-1006-405c-8730-0a9b8d69d107 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=77321e9c7ec34370b1b8246dde35911b) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:19.573825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ecbf5-1006-405c-8730-0a9b8d69d107 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:19.575724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ecbf5-1006-405c-8730-0a9b8d69d107 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:19.582552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 360/718] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:19 2022] GET /identity/v3/role_assignments?user.id=77321e9c7ec34370b1b8246dde35911b&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:20.453984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa847f-5359-4d3e-a4fa-c8a24bde23c4 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.453984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa847f-5359-4d3e-a4fa-c8a24bde23c4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.453984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa847f-5359-4d3e-a4fa-c8a24bde23c4 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.455245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 359/719] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:20.460835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353514-c949-47e0-a1d3-dfb749980595 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.461640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353514-c949-47e0-a1d3-dfb749980595 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.462660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20353514-c949-47e0-a1d3-dfb749980595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.487745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-20353514-c949-47e0-a1d3-dfb749980595 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:20.489264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-20353514-c949-47e0-a1d3-dfb749980595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:20.498638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 361/720] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 31 04:26:20.535031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa847f-5359-4d3e-a4fa-c8a24bde23c4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.550938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa847f-5359-4d3e-a4fa-c8a24bde23c4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.557570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.558604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.559104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.559579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.575765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:20.582989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:20.584718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 360/721] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:20.591023 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20353514-c949-47e0-a1d3-dfb749980595 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.604473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20353514-c949-47e0-a1d3-dfb749980595 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.613226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.614143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.614622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.615110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.616074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:20.616603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:20.618680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:20.630177 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 362/722] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:20.636476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.646384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e59f-4781-4213-a1a1-864f6ddee099 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.653988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.655028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.655526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.655997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.672584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:20.674705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:20.694819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:20.697150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 361/723] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:20.702545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.712768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11972f0-567b-4cd1-bdb7-2cd5e1e1e6cf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.723921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.724795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.725281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.725755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.726694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:20.727255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:20.729946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:20.746748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 363/724] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:20.751936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.767636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db45c-6fd9-4639-932a-8dd5e9dcbcc8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.772506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.773531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.774013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.774552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.786613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:20.788870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:20.808130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:20.809817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 362/725] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:20.815151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.827703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7464f-323f-4cab-abd0-d9a6ee6e0531 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.832621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.833505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.833984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.834470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.835551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:20.836054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:20.838242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:20.862422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 364/726] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:20.867549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.878064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad5c24-5a1a-471b-8001-9b438a78e670 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.887885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.888925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.889413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.889889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.905686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:20.908064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:20.931796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:20.933237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 363/727] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:20.938903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.949276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecf04d-df2c-4af1-9d3e-3e266f9602fd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:20.958933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:20.959848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:20.960345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:20.960832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:20.962321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:20.962905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:20.964695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:20.981386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 365/728] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:20.986942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:20.999697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc683f3f-47d8-4808-989e-8ee676761d61 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.004656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.005664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.006145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.006620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.017835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:21.020108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:21.037765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:21.039579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 364/729] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:21.045314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:21.056316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cc29e-1aa0-4381-979a-f1be3b75c517 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.067465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c9b90-eaaf-4219-a90b-3e880a96ec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.068506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9b90-eaaf-4219-a90b-3e880a96ec0a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.068991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9b90-eaaf-4219-a90b-3e880a96ec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.069467 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9b90-eaaf-4219-a90b-3e880a96ec0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.070523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c9b90-eaaf-4219-a90b-3e880a96ec0a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:21.071108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c9b90-eaaf-4219-a90b-3e880a96ec0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:21.073322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c9b90-eaaf-4219-a90b-3e880a96ec0a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:21.104333 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 366/730] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:21.110122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:21.120793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52bcb4-a4c5-4003-8231-6322cc2b5edf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.126912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1392b-be46-443c-9c12-440dfeaafea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.128017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1392b-be46-443c-9c12-440dfeaafea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.128500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1392b-be46-443c-9c12-440dfeaafea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.128996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1392b-be46-443c-9c12-440dfeaafea5 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/bf69b08068054c4180f2d44c9c07cb60/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.132302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1392b-be46-443c-9c12-440dfeaafea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=bf69b08068054c4180f2d44c9c07cb60, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:21.135365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1392b-be46-443c-9c12-440dfeaafea5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:21.220439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 365/731] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:21 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/bf69b08068054c4180f2d44c9c07cb60/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:21.438847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bc12-db0f-4869-ab30-01644cdec3f4 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.439513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bc12-db0f-4869-ab30-01644cdec3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.440011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4bc12-db0f-4869-ab30-01644cdec3f4 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.442439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 367/732] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:21.449457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757c551-f122-4ca0-a400-f7f5c5d1d3b0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.450101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757c551-f122-4ca0-a400-f7f5c5d1d3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.450608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757c551-f122-4ca0-a400-f7f5c5d1d3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.476030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3757c551-f122-4ca0-a400-f7f5c5d1d3b0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:21.478613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3757c551-f122-4ca0-a400-f7f5c5d1d3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:21.545683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 366/733] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 31 04:26:21.573595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4bc12-db0f-4869-ab30-01644cdec3f4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:21.586882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4bc12-db0f-4869-ab30-01644cdec3f4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.591613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797f0f-bbad-462c-b8a2-7a147176ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.594552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797f0f-bbad-462c-b8a2-7a147176ddcb admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.595094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797f0f-bbad-462c-b8a2-7a147176ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.595564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797f0f-bbad-462c-b8a2-7a147176ddcb admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.596568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9797f0f-bbad-462c-b8a2-7a147176ddcb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:21.597779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-a9797f0f-bbad-462c-b8a2-7a147176ddcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:21.597779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:26:21.597779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:26:21.599231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9797f0f-bbad-462c-b8a2-7a147176ddcb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:21.705017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 368/734] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:21 2022] POST /identity/v3/services => generated 251 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:21.728862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168057be-6125-4727-aef9-94a8f2817bf8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.729141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168057be-6125-4727-aef9-94a8f2817bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.729326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168057be-6125-4727-aef9-94a8f2817bf8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.731457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 367/735] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:21.737195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a724-3d39-451e-ae21-36a8b6e0a93e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.737958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a724-3d39-451e-ae21-36a8b6e0a93e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.738471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73a724-3d39-451e-ae21-36a8b6e0a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.760905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-de73a724-3d39-451e-ae21-36a8b6e0a93e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:21.762508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-de73a724-3d39-451e-ae21-36a8b6e0a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:21.781976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 369/736] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:21 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:21.826316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168057be-6125-4727-aef9-94a8f2817bf8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:21.852781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168057be-6125-4727-aef9-94a8f2817bf8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.860065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.860866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.861159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.861426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.866545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfc7b-fc89-4ba6-8f39-b5937f917c32 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.866870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfc7b-fc89-4ba6-8f39-b5937f917c32 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.867145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cfc7b-fc89-4ba6-8f39-b5937f917c32 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.870989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 370/737] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:21.875463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444760d5-72ad-487e-a36e-390e7d4da96d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.875749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444760d5-72ad-487e-a36e-390e7d4da96d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.876020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444760d5-72ad-487e-a36e-390e7d4da96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.880722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:21.887833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:21.889070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 368/738] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:21.894642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:21.895287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-444760d5-72ad-487e-a36e-390e7d4da96d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:21.896568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-444760d5-72ad-487e-a36e-390e7d4da96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:21.910951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 371/739] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:21 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:21.912922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194a80c-16c9-47e1-9de9-9063b77d771c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.921538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.922224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.922504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.922779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.923581 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:21.923883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:21.925498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:21.930043 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444760d5-72ad-487e-a36e-390e7d4da96d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:21.937017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 369/740] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:21.940647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444760d5-72ad-487e-a36e-390e7d4da96d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.941795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:21.947633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.948306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.948584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.948857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.949853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:21.952085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:21.956145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c52282-67ba-4685-ab40-aa101ffb2cd7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:21.963721 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:21.964549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:21.964861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:21.965135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:21.980572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:21.982333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.002005 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:22.003527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 370/741] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:22.009296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.019572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b969db-d9c7-440e-93a8-08f49a5d7111 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.025104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.025861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.028788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.030327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.034650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 372/742] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:21 2022] POST /identity/v3/services => generated 240 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:22.035458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:22.042442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.042442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.056366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 371/743] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:22.062092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.092904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf64a6-5b34-4342-bf38-0a62ad5c28c0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.098610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.099507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.099782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.100053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.110823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.112917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.131858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 31 04:26:22.133077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 373/744] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:22.139971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.150673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392e94e-5ca0-47fd-bed9-83f155024a06 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.155683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.156361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.156946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.157271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.158140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:22.158499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.160543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.183418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 372/745] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:22.186218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.197395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6e73b-d4b1-4977-b1e2-277885ce0397 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.206703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.207458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.207738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.208008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.222620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.224535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.238152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 374/746] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:22.244378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.256253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b124af-3dfc-40e4-b1c6-044456706084 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.263655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.264514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.264792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.265119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.281341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.283752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.306513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:22.307964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 373/747] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:22.313555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.324537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420387-90b2-40a6-bb62-b8cc24be2b8d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.330152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.330929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.331211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.331481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.332203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:22.332501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.334070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.347386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 375/748] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:22.353151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.367458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb0dfe-3771-4ec9-9bd2-c375157ab284 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.373423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.374482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.375031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.375488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.384600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.386885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.404584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:22.406929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 374/749] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:22.412390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.433008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcabc-3462-48ed-a482-efd2b2b9d4ad admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.441354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4722c2-0ce8-4242-a3ca-840397785df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.442015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4722c2-0ce8-4242-a3ca-840397785df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.442291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4722c2-0ce8-4242-a3ca-840397785df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.442564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4722c2-0ce8-4242-a3ca-840397785df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.443407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4722c2-0ce8-4242-a3ca-840397785df3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:22.443708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4722c2-0ce8-4242-a3ca-840397785df3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.445568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4722c2-0ce8-4242-a3ca-840397785df3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.465838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 376/750] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:22.471818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.487781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58790574-b98d-47fb-b544-02b6ac39859e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.497233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62dde3-272b-4c88-89ee-2cd835d792b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.498173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62dde3-272b-4c88-89ee-2cd835d792b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.498646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62dde3-272b-4c88-89ee-2cd835d792b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.499161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62dde3-272b-4c88-89ee-2cd835d792b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.500261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62dde3-272b-4c88-89ee-2cd835d792b7 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=c1d552a7c37744e1b7b61a33d34ceedb) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:22.500760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62dde3-272b-4c88-89ee-2cd835d792b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:22.502853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62dde3-272b-4c88-89ee-2cd835d792b7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:22.514895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 375/751] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/role_assignments?user.id=c1d552a7c37744e1b7b61a33d34ceedb&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:22.855063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e012-7701-4957-9d56-d95624c81a41 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.855562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e012-7701-4957-9d56-d95624c81a41 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.855562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e012-7701-4957-9d56-d95624c81a41 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.857564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 377/752] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:22.862665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545625a7-63fd-4742-849d-a59af702ce10 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.862993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545625a7-63fd-4742-849d-a59af702ce10 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.863268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545625a7-63fd-4742-849d-a59af702ce10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.895864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-545625a7-63fd-4742-849d-a59af702ce10 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:22.897093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-545625a7-63fd-4742-849d-a59af702ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:22.905493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 376/753] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:22 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:22.932122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5e012-7701-4957-9d56-d95624c81a41 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.949146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5e012-7701-4957-9d56-d95624c81a41 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:22.957226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:22.958011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:22.958290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:22.958564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:22.972747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:22.980052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:22.981545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 378/754] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:22.987170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545625a7-63fd-4742-849d-a59af702ce10 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:22.996451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545625a7-63fd-4742-849d-a59af702ce10 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.006861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.007524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.007803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.008075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.009463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:23.009770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.011396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.020181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 377/755] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:23.027857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.041826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330599c7-d6f6-4e48-a4a8-c5262864fef0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.051408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.052185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.052466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.052738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.067884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.069755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.098038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:23.099597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 379/756] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:23.105549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.120508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5fbd6-3dbc-4574-beb2-bb1bfd06d2ec admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.136372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.137048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.137331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.137607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.138349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:23.138652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.140290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.161680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 378/757] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:23.167266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.177125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4956d-ed9f-466d-a332-b0937e17890a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.182206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.183017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.183298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.183593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.191782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.193820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.207542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 31 04:26:23.209038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 380/758] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:23.215582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.225610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99995571-9bcf-4938-b0c9-bbd89b3e4ebb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.230218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.230900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.231183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.231455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.232304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:23.232603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.234448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.252775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 379/759] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:23.258180 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.268322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ffd5d-c963-4d1d-bfda-b8329adc1636 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.272878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.273509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.273789 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.274576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.282948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.284709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.294349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 381/760] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:23.299826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.310736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31717ec-3932-4022-bb78-091aba365bf0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.315494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.316303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.316586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.316860 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.327976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.329854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.348389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:23.349592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 380/761] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:23.355390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.364589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8fbbb-b1a8-450d-b9c4-e3098dc9bfe7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.369955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.370725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.371110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.371388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.372118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:23.372421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.374119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.387343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 382/762] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:23.392813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.403795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e229f0-0e1b-419d-bcab-601a12ac1d29 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.408711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.409545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.409832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.410161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.417807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.419913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.434388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:23.435888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 381/763] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:23.441515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.451709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13956b07-f4e7-403b-a466-7c9b0f179687 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.456375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f6ba-5ec4-47f3-8ecb-9d1ceaf25094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.457016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f6ba-5ec4-47f3-8ecb-9d1ceaf25094 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.457341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f6ba-5ec4-47f3-8ecb-9d1ceaf25094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.457621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f6ba-5ec4-47f3-8ecb-9d1ceaf25094 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.458416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f6ba-5ec4-47f3-8ecb-9d1ceaf25094 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:23.458769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f6ba-5ec4-47f3-8ecb-9d1ceaf25094 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.460713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f6ba-5ec4-47f3-8ecb-9d1ceaf25094 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.473798 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 383/764] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:23.479584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:23.490417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cdd86-677a-417b-889f-4ff3d9de62ed admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:23.495664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a677b56-2714-4465-8984-6681579efaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:23.496291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a677b56-2714-4465-8984-6681579efaef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:23.496627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a677b56-2714-4465-8984-6681579efaef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:23.496900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a677b56-2714-4465-8984-6681579efaef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:23.497839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a677b56-2714-4465-8984-6681579efaef admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=77321e9c7ec34370b1b8246dde35911b) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:23.498200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a677b56-2714-4465-8984-6681579efaef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:23.500134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a677b56-2714-4465-8984-6681579efaef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:23.506242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 382/765] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:23 2022] GET /identity/v3/role_assignments?user.id=77321e9c7ec34370b1b8246dde35911b&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.214487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea333-1f28-45bb-87de-1c5acd4824c6 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.215293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea333-1f28-45bb-87de-1c5acd4824c6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.215293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ea333-1f28-45bb-87de-1c5acd4824c6 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.217108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 384/766] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:24.222100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66e34-7d7d-4aa4-ab41-04e7212f8c69 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.222392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66e34-7d7d-4aa4-ab41-04e7212f8c69 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.222667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b66e34-7d7d-4aa4-ab41-04e7212f8c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.240667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-39b66e34-7d7d-4aa4-ab41-04e7212f8c69 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:24.241859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-39b66e34-7d7d-4aa4-ab41-04e7212f8c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:24.257531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 383/767] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:24 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:24.293153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ea333-1f28-45bb-87de-1c5acd4824c6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.308832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ea333-1f28-45bb-87de-1c5acd4824c6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.313249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.314019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.314300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.314572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.326403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:24.333325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:24.334566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 385/768] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:24.341074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b66e34-7d7d-4aa4-ab41-04e7212f8c69 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.350300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b66e34-7d7d-4aa4-ab41-04e7212f8c69 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.355235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.355893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.356178 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.356457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.357217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.357521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.359140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.368307 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 384/769] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.373771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.384653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a39ec-2711-4d08-bfc6-eefbc09e49db admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.389600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.390463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.390749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.391052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.407585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.409464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.431733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:24.432929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 386/770] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:24.438467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.453287 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac95b-56e8-4e51-9fa2-8073f9a93691 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.458113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.458905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.459189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.459466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.460267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.460572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.462705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.475852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 385/771] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.481736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.491697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2cef2-cea3-428d-985c-5f191d7352ef admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.496485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.497350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.497628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.497899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.505612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.507759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.524128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:24.526179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 387/772] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:24.532041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.548124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529be144-2adf-4d81-9059-45a4e7255527 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.559049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.559747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.568451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.568451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.568451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.568451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.568451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.594189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 386/773] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.599780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.612599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84d024-7946-410c-8685-4312d79e5f94 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.623415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7bf6c-a0a3-45c7-8db6-cb75efd4b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.624342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7bf6c-a0a3-45c7-8db6-cb75efd4b2ac admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.624820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7bf6c-a0a3-45c7-8db6-cb75efd4b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.625308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7bf6c-a0a3-45c7-8db6-cb75efd4b2ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.634631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7bf6c-a0a3-45c7-8db6-cb75efd4b2ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.636757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7bf6c-a0a3-45c7-8db6-cb75efd4b2ac admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.646514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 388/774] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:24.652011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.668334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de761b0-4520-4a8d-8154-8b3552cbf740 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.676798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.677896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.678377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.678888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.694323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.697137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.710734 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71b660-412c-43c5-ae80-a321d337707d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.711051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71b660-412c-43c5-ae80-a321d337707d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.711329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71b660-412c-43c5-ae80-a321d337707d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.713973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 389/775] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:24.719052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd804af-ebb1-4c8b-a1e3-5cd4d523ec35 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.719334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd804af-ebb1-4c8b-a1e3-5cd4d523ec35 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.719606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd804af-ebb1-4c8b-a1e3-5cd4d523ec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.719826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:24.721453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 387/776] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:24.727169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.741911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49662392-0727-4511-864c-5d180f0dacef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.746813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-5dd804af-ebb1-4c8b-a1e3-5cd4d523ec35 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:24.746813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5dd804af-ebb1-4c8b-a1e3-5cd4d523ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:24.751299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.752215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.752694 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.753164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.753716 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 390/777] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:24 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:24.754309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.754827 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.756647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.776579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 388/778] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.782399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd804af-ebb1-4c8b-a1e3-5cd4d523ec35 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.791979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.795002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd804af-ebb1-4c8b-a1e3-5cd4d523ec35 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.800024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8b4b8-66fa-4fc0-8729-c11768599176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.800866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b4b8-66fa-4fc0-8729-c11768599176 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.801192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b4b8-66fa-4fc0-8729-c11768599176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.801509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8b4b8-66fa-4fc0-8729-c11768599176 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.808690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017be1-94b1-42e7-8df2-1754fc5fc9f8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.812395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8b4b8-66fa-4fc0-8729-c11768599176 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.814857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8b4b8-66fa-4fc0-8729-c11768599176 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.819667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.820591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.821196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.821349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.822102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.823937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.831929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-9aa8b4b8-66fa-4fc0-8729-c11768599176 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:24.833413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 391/779] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:24.834640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c9caf-5ebb-4446-a948-3c5c445d35ec None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.835814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 31 04:26:24.837652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 389/780] 10.222.0.21 () {56 vars in 1150 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:24.839015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c9caf-5ebb-4446-a948-3c5c445d35ec None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.839323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c9caf-5ebb-4446-a948-3c5c445d35ec None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.841168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 392/781] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:24.846139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.847266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c9caf-5ebb-4446-a948-3c5c445d35ec None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.858451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275325a-2554-4e5a-84ad-bbedb965cb41 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.863053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bee37f-127c-40e6-b0a5-6f61a6d421f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.863698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bee37f-127c-40e6-b0a5-6f61a6d421f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.864082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bee37f-127c-40e6-b0a5-6f61a6d421f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.864404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bee37f-127c-40e6-b0a5-6f61a6d421f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.865221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bee37f-127c-40e6-b0a5-6f61a6d421f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.865561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bee37f-127c-40e6-b0a5-6f61a6d421f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.867551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bee37f-127c-40e6-b0a5-6f61a6d421f8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.874148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c9caf-5ebb-4446-a948-3c5c445d35ec None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.880207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.881096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.881398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 390/782] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.886409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.886527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44f91e-30ea-4a59-86ed-f71a4e1a867a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.886527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44f91e-30ea-4a59-86ed-f71a4e1a867a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.886527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44f91e-30ea-4a59-86ed-f71a4e1a867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.887642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.888695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.889300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.891236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.897800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 393/783] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.903784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.908717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3e44f91e-30ea-4a59-86ed-f71a4e1a867a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:24.909906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3e44f91e-30ea-4a59-86ed-f71a4e1a867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:24.918416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 391/784] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:24 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:24.918983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44f91e-30ea-4a59-86ed-f71a4e1a867a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.920397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f33d1-1731-43ac-b50a-080c418d61e0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.925460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.926390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.926948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.927438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.928588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=bf69b08068054c4180f2d44c9c07cb60) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.929107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.932536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.940425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 394/785] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/role_assignments?user.id=bf69b08068054c4180f2d44c9c07cb60&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.949378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44f91e-30ea-4a59-86ed-f71a4e1a867a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.953388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.956055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.956730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.957012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.957289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.958023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:24.958326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.959977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:24.966747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4f895-1f4a-40ed-9a61-d86193e819c5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:24.975268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 392/786] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:24.981605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:24.982130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:24.983160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:24.983684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:24.984158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] PATH_INFO: `/v3/services/network` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:24.985068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:24.986955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.000762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa6b7f-d5cf-4482-9d14-5cb6f48392c6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.013451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.014171 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.014452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.014754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.015615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] RBAC: Adding query filter params (interface=public, service_id=ad0f0e64aa904a24a4c8c98f2c728ae8, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:25.015924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.016681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 31 04:26:25.018086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:25.018086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:26:25.018086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:26:25.019036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.020242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 395/787] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/services/network => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:25.027069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.039972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b11b5-b192-4a09-8bc8-cf2357bd707e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.042289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 393/788] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:26:24 2022] GET /identity/v3/endpoints?service_id=ad0f0e64aa904a24a4c8c98f2c728ae8&interface=public®ion_id=RegionOne => generated 194 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.048650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.057929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.058600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.058906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.059251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.059986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:25.060618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.063698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.069064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68785-8bf4-4045-af0a-e9f66671df85 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.075769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 396/789] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.078261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.082080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.082258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.082258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.082258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.082258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.084025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.099604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 394/790] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/services => generated 772 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.113228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610832-5aad-4a61-934f-084407312512 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.128782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.129466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.129753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.130026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.130779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:25.131106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.132795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.146204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 397/791] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.152321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.169012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b20dc-292d-4527-bcef-32e5c56fc3c3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.174015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c28e7-7d53-462d-adba-22ebf3a97c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.174741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c28e7-7d53-462d-adba-22ebf3a97c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.175058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c28e7-7d53-462d-adba-22ebf3a97c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.175335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c28e7-7d53-462d-adba-22ebf3a97c42 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.176230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c28e7-7d53-462d-adba-22ebf3a97c42 admin admin] RBAC: Adding query filter params (interface=public, service_id=34a096b518a5412b99cb893e5149c760, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:25.176546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c28e7-7d53-462d-adba-22ebf3a97c42 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.179848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c28e7-7d53-462d-adba-22ebf3a97c42 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.187398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 395/792] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/endpoints?service_id=34a096b518a5412b99cb893e5149c760&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.193071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.205230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334fe65-d8bd-428b-80e0-3b174097bd28 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.210131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba10562-8f0f-4683-9771-5069e5e6b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.210927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10562-8f0f-4683-9771-5069e5e6b3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.211211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10562-8f0f-4683-9771-5069e5e6b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.211516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10562-8f0f-4683-9771-5069e5e6b3f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.212363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba10562-8f0f-4683-9771-5069e5e6b3f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.214038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba10562-8f0f-4683-9771-5069e5e6b3f2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.220394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 398/793] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.559352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bc42-daa9-4dfc-bb2b-f49a32c87322 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.560083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bc42-daa9-4dfc-bb2b-f49a32c87322 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.560083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bc42-daa9-4dfc-bb2b-f49a32c87322 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.561940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 396/794] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:25.567111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf7d07-ee6b-448e-9711-56007de8e155 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.567344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf7d07-ee6b-448e-9711-56007de8e155 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.567588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf7d07-ee6b-448e-9711-56007de8e155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.591298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-49bf7d07-ee6b-448e-9711-56007de8e155 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:25.592494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-49bf7d07-ee6b-448e-9711-56007de8e155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:25.605531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 399/795] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:25.643035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241bc42-daa9-4dfc-bb2b-f49a32c87322 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.657374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241bc42-daa9-4dfc-bb2b-f49a32c87322 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.667437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.668235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.668520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.668851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.683720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:25.690678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:25.692069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 397/796] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:25.697972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf7d07-ee6b-448e-9711-56007de8e155 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.707125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf7d07-ee6b-448e-9711-56007de8e155 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.715587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.716301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.716586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.716864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.717626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:25.717927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.719554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.734437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 400/797] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.740226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.750404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb9464-990c-4943-ac49-9bfa8c6e5aa9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.758944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.759959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.760536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.761043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.771830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.774603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.793228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:25.795021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 398/798] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:25.800556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.820454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335741d9-283e-4ae3-83f1-ebb884b2e4ff admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.829331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.830034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.830322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.830653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.831422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:25.831725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.833376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.851710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 401/799] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.857538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.868468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86366353-e7f7-4ad2-85d3-0ec33519e479 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.880642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.881459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.881737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.882007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.892939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.895070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.916981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 31 04:26:25.918226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 399/800] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:25.924012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.934532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969c70-4a08-4822-b082-6f3f28ae5d8c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.939145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.939847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:25.940127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:25.940450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:25.941412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:25.941724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:25.943837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:25.971698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 402/801] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:25.978049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:25.994385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffadb2d-3189-4570-b90b-d0b483f32161 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:25.999123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:25.999946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.000248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.000527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.011968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.013867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.032116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:26.037928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 400/802] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:26.039318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.052153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47770875-be99-4bd3-ace8-c6920b5a579a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.057032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.057725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.058006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.058326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.059089 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:26.059438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.061085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.078846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 403/803] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:26.081646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.095073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dce87-b438-48eb-a092-5bbddfb52ebe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.102964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.103799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.104128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.104403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.118735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.120772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.140548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:26.142189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 401/804] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:26.149103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.164662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df417ef1-0493-48c6-8563-b03ad1dce62b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.171335 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943c24e-79e8-4e49-8257-0f5e6c1a9c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.172006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c24e-79e8-4e49-8257-0f5e6c1a9c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.172334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c24e-79e8-4e49-8257-0f5e6c1a9c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.172609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c24e-79e8-4e49-8257-0f5e6c1a9c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.173421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c24e-79e8-4e49-8257-0f5e6c1a9c9d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:26.173773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c24e-79e8-4e49-8257-0f5e6c1a9c9d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.175783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c24e-79e8-4e49-8257-0f5e6c1a9c9d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.198905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 404/805] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:26.206839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.224508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297ee97-d34a-4533-9c18-317bae2e2dc1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.234462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0266f3c-eadb-4aee-b141-103e4d9b963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.235376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266f3c-eadb-4aee-b141-103e4d9b963c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.235703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266f3c-eadb-4aee-b141-103e4d9b963c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.235975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266f3c-eadb-4aee-b141-103e4d9b963c admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/c1d552a7c37744e1b7b61a33d34ceedb/roles/a36d2857a03b44cc8c9eaad52457f4f3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.255191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0266f3c-eadb-4aee-b141-103e4d9b963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=c1d552a7c37744e1b7b61a33d34ceedb, role_id=a36d2857a03b44cc8c9eaad52457f4f3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.257913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0266f3c-eadb-4aee-b141-103e4d9b963c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.348072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 402/806] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:26 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/c1d552a7c37744e1b7b61a33d34ceedb/roles/a36d2857a03b44cc8c9eaad52457f4f3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:26.483522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc706e3-7a63-4a30-8162-ff01c0149602 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.484038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc706e3-7a63-4a30-8162-ff01c0149602 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.484038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc706e3-7a63-4a30-8162-ff01c0149602 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.486129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 405/807] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:26.491907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de63eaa-a860-4014-a121-878d19f0c2d7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.492208 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de63eaa-a860-4014-a121-878d19f0c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.492485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de63eaa-a860-4014-a121-878d19f0c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.512756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0de63eaa-a860-4014-a121-878d19f0c2d7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:26.513976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0de63eaa-a860-4014-a121-878d19f0c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:26.582943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 403/808] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:26 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:26.610914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc706e3-7a63-4a30-8162-ff01c0149602 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.626133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc706e3-7a63-4a30-8162-ff01c0149602 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.630741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.631754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.632216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.632692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.651002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:26.658442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:26.660354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 406/809] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:26.666762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de63eaa-a860-4014-a121-878d19f0c2d7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.676478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de63eaa-a860-4014-a121-878d19f0c2d7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.683516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.684460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.684925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.685378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.686344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:26.686848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.688621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.699114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 404/810] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:26.704622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.715653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7d46-dfe8-4090-a809-3d43ebf9617a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.720570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.721593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.722055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.722556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.736176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.738381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.755946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:26.757767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 407/811] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:26.764338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.774703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbf337-8287-485d-bca0-9b536c6be4bc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.781234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.782391 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.782935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.783406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.784384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:26.784867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.786730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.802360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 405/812] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:26.808127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.818609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60573c-e794-4cd7-acdf-d4eaf02767f7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.824068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.825049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.825507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.825955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.834605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.836909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.851050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 31 04:26:26.853439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 408/813] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:26.860155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.873193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6df0ec-6652-47af-b9dd-73d63b487cbf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.879000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.879926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.880415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.880887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.881995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:26.882550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.885255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:26.913512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 406/814] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:26.919048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:26.942914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfad889-85a4-4fdc-92b6-b77a3474175c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:26.960434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:26.961232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:26.961544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:26.961817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:26.983108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:26.984939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.002118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:27.006896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 409/815] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:27.010155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.033373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20054c1-593c-4c5f-84be-dd41a785f749 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.048757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.049418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.049698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.049969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.050708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:27.051042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.052635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.072852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 407/816] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:27.078317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.092470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb684e46-ed3d-49ea-8c98-07c2dd1fd375 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.096850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.097621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.097898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.098167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.115896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.118400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.138575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:27.139701 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 410/817] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:27.145613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.163631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3462d9-fd0b-45d6-a897-d26183b19d1e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.170824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaabd09-8330-4825-86ee-dc6a01a80110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.171464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaabd09-8330-4825-86ee-dc6a01a80110 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.171745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaabd09-8330-4825-86ee-dc6a01a80110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.172022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaabd09-8330-4825-86ee-dc6a01a80110 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.172815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaabd09-8330-4825-86ee-dc6a01a80110 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:27.173118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaabd09-8330-4825-86ee-dc6a01a80110 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.174978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaabd09-8330-4825-86ee-dc6a01a80110 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.196155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 408/818] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:27.201690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.216404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a905a44-6831-486b-88fb-c61ec5b9e754 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.220820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5986379-539e-40aa-9777-9e3c8bfaa19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.221688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986379-539e-40aa-9777-9e3c8bfaa19d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.221962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986379-539e-40aa-9777-9e3c8bfaa19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.222225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986379-539e-40aa-9777-9e3c8bfaa19d admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/77321e9c7ec34370b1b8246dde35911b/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.224192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5986379-539e-40aa-9777-9e3c8bfaa19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=77321e9c7ec34370b1b8246dde35911b, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.234835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5986379-539e-40aa-9777-9e3c8bfaa19d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.409619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 411/819] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:27 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/77321e9c7ec34370b1b8246dde35911b/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:27.660613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4cdb-8170-4ffd-87af-f1b508566e35 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.661108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4cdb-8170-4ffd-87af-f1b508566e35 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.661108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce4cdb-8170-4ffd-87af-f1b508566e35 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.663146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 409/820] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:27.668975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea3ba-3399-4185-a7d7-373b12ff6679 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.669601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea3ba-3399-4185-a7d7-373b12ff6679 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.669772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ea3ba-3399-4185-a7d7-373b12ff6679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.690481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-390ea3ba-3399-4185-a7d7-373b12ff6679 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:27.691964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-390ea3ba-3399-4185-a7d7-373b12ff6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:27.757966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 412/821] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:27.783755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce4cdb-8170-4ffd-87af-f1b508566e35 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.803596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce4cdb-8170-4ffd-87af-f1b508566e35 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.810918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.811728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.812008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.812286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.812961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.814591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.831112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 31 04:26:27.832688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 410/822] 10.222.0.21 () {56 vars in 1150 bytes} [Mon Jan 31 04:26:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:27.839366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ea3ba-3399-4185-a7d7-373b12ff6679 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.848763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ea3ba-3399-4185-a7d7-373b12ff6679 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.855820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.856475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.856751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.857019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.857727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:27.858025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.859648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.871222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 413/823] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Jan 31 04:26:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:27.876409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.890351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce158fb-e519-4028-9dc8-511c85d5f311 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.897355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860e0dc-3317-4cfc-8aa8-546fdfbf3b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.898304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e0dc-3317-4cfc-8aa8-546fdfbf3b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.898829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e0dc-3317-4cfc-8aa8-546fdfbf3b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.899641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e0dc-3317-4cfc-8aa8-546fdfbf3b7d admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.900578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860e0dc-3317-4cfc-8aa8-546fdfbf3b7d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:27.901104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860e0dc-3317-4cfc-8aa8-546fdfbf3b7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.907050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860e0dc-3317-4cfc-8aa8-546fdfbf3b7d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.912926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 411/824] 10.222.0.21 () {56 vars in 1145 bytes} [Mon Jan 31 04:26:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:27.919075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:27.934810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2daa17-ab1b-48f3-a9c2-75fceb88ce96 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:27.939203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:27.939839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.940114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.940381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.941129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:27.942300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:27.942300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:26:27.942300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:26:27.947286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:27.991482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd808d-6f1f-4a97-af96-b56694c644ff None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:27.992106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd808d-6f1f-4a97-af96-b56694c644ff None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:27.992606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd808d-6f1f-4a97-af96-b56694c644ff None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:27.995424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 412/825] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:28.000997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958c0b-9164-4e09-853d-94d48b49c3e9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.001531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958c0b-9164-4e09-853d-94d48b49c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.002023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958c0b-9164-4e09-853d-94d48b49c3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.020832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-de958c0b-9164-4e09-853d-94d48b49c3e9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:28.022320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-de958c0b-9164-4e09-853d-94d48b49c3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:28.032366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 413/826] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:28.054585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 414/827] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:28.058673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958c0b-9164-4e09-853d-94d48b49c3e9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:28.069000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958c0b-9164-4e09-853d-94d48b49c3e9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:28.099399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:28.100328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.100617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.100901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.101594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:28.104119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:28.116713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 31 04:26:28.118630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 414/828] 10.222.0.21 () {56 vars in 1153 bytes} [Mon Jan 31 04:26:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:28.124667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:28.136563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45097f-8b03-4833-9972-c313b6c8f30c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:28.145870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f19c46-0a1b-478a-92f0-6dcea5af0ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:28.146570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19c46-0a1b-478a-92f0-6dcea5af0ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.146914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19c46-0a1b-478a-92f0-6dcea5af0ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.147193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f19c46-0a1b-478a-92f0-6dcea5af0ea5 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.148017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f19c46-0a1b-478a-92f0-6dcea5af0ea5 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:28.148336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f19c46-0a1b-478a-92f0-6dcea5af0ea5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:28.150136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f19c46-0a1b-478a-92f0-6dcea5af0ea5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:28.155954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 415/829] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:28.162100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:28.180715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf7d8d-188d-4686-a378-8f3c0a1cfeba admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:28.186086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec929f62-7d32-4988-a292-6bddd47a2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:28.186822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929f62-7d32-4988-a292-6bddd47a2cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.187116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929f62-7d32-4988-a292-6bddd47a2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.187442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929f62-7d32-4988-a292-6bddd47a2cc9 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.188189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec929f62-7d32-4988-a292-6bddd47a2cc9 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:28.188517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec929f62-7d32-4988-a292-6bddd47a2cc9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:28.190198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec929f62-7d32-4988-a292-6bddd47a2cc9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:28.198777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 415/830] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:28.454291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47dcc-38d0-4452-96e0-2f4f2c87b5d1 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.454648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47dcc-38d0-4452-96e0-2f4f2c87b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.454936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea47dcc-38d0-4452-96e0-2f4f2c87b5d1 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.456729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 416/831] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:28.463339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff7f17-11ea-4114-b518-0df40c4c5db0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.463622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff7f17-11ea-4114-b518-0df40c4c5db0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.463892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff7f17-11ea-4114-b518-0df40c4c5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.482600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-62ff7f17-11ea-4114-b518-0df40c4c5db0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:28.483808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-62ff7f17-11ea-4114-b518-0df40c4c5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:28.493724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 416/832] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:28 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:28.516681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea47dcc-38d0-4452-96e0-2f4f2c87b5d1 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:28.529603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea47dcc-38d0-4452-96e0-2f4f2c87b5d1 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:28.534117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:28.534944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.535219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.535486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.536147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:28.537723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:28.549063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 31 04:26:28.554901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 417/833] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:28 2022] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:28.556994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff7f17-11ea-4114-b518-0df40c4c5db0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:28.566308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff7f17-11ea-4114-b518-0df40c4c5db0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:28.571206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:28.571846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.572123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.572392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.573183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:28.573481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:28.575125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:28.585551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 417/834] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:28.586219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:28.596981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad3f27-ca8f-49c5-9148-720507ed71e6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:28.601606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2264d4-8285-4a0b-a983-6179dd6aac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:28.602479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2264d4-8285-4a0b-a983-6179dd6aac71 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.602759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2264d4-8285-4a0b-a983-6179dd6aac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.603236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2264d4-8285-4a0b-a983-6179dd6aac71 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.604008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2264d4-8285-4a0b-a983-6179dd6aac71 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:28.604304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2264d4-8285-4a0b-a983-6179dd6aac71 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:28.606007 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2264d4-8285-4a0b-a983-6179dd6aac71 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:28.614917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 418/835] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:28.617123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:28.628107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd864d9-2d9e-4501-9f1d-0c1a2c96215c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:28.632795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7734-a577-4ec1-aaab-56bc1bdc2bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:28.633717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7734-a577-4ec1-aaab-56bc1bdc2bdc admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:28.634044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7734-a577-4ec1-aaab-56bc1bdc2bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:28.634498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7734-a577-4ec1-aaab-56bc1bdc2bdc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:28.635348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd7734-a577-4ec1-aaab-56bc1bdc2bdc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:28.636410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-6bcd7734-a577-4ec1-aaab-56bc1bdc2bdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:28.636410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:26:28.636410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:26:28.637283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd7734-a577-4ec1-aaab-56bc1bdc2bdc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:28.715792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 418/836] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:29.175784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af924-1673-4353-bb39-f7cc8fb97830 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.176423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af924-1673-4353-bb39-f7cc8fb97830 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.176423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5af924-1673-4353-bb39-f7cc8fb97830 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.178352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 419/837] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:29.184247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2bd2d-528c-4597-b7db-8ea1740fcc71 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.184537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2bd2d-528c-4597-b7db-8ea1740fcc71 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.184816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2bd2d-528c-4597-b7db-8ea1740fcc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.207745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-00b2bd2d-528c-4597-b7db-8ea1740fcc71 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:29.208954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-00b2bd2d-528c-4597-b7db-8ea1740fcc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:29.228468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 419/838] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:29 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:29.257408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af924-1673-4353-bb39-f7cc8fb97830 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.275280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5af924-1673-4353-bb39-f7cc8fb97830 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.279890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.280671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.280949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.281224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.296967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:29.303890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:26:29.306079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 420/839] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:29.311535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2bd2d-528c-4597-b7db-8ea1740fcc71 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.320982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2bd2d-528c-4597-b7db-8ea1740fcc71 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.325498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.326150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.326424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.326691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.327490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:29.327786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.329371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.342422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 420/840] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:29.344793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.355246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddbd39-ed27-4b15-ba08-26661c687e8b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.359810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.360623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.360896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.361212 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.372572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.374380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.390901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:29.396955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 421/841] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:29.398353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.409036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8c6d-ee49-4dfb-ba18-0c40eee0e953 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.413564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.414260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.414600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.414963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.415652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:29.415950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.417622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.434167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 421/842] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:29.436596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.446330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2816b-ad0a-4d7f-a245-426e1f90a743 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.450823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.451628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.451903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.452172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.460174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.462711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.477078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 31 04:26:29.482810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 422/843] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:29.484124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.494766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85994c4b-7b4f-4629-a5d3-4637d49f23f2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.499308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.499956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.500233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.500498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.501340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:29.501637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.503508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.526508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 422/844] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:29.527847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.538139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4df9-99d5-4770-9955-640377fd250f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.543108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.543739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.544042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.544317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.552652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.554448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.569938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 423/845] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:29.572626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.582900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09add3-4262-47fa-a05d-896fcdcbfc8f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.588450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.589234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.589511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.589779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.601142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.602971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.621284 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:29.626898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 423/846] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:29.628453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.643028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1696d-74fe-4c3b-a6a4-c2012a800f4e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.647245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.648119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.648579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.649661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.650845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:29.651326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.653144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.667058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 424/847] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:29.676103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.685969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48958e5-4c46-4f14-84c4-b311f6ae29bb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.690456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.691255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.691593 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.692036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.700021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.701977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.715012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:29.720752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 424/848] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:29.722091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.732210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa3c93-a791-4b21-92da-ffadcc1784c8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.736600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf825f4e-e8ec-4b38-9e97-a0886e0c0e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.737230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf825f4e-e8ec-4b38-9e97-a0886e0c0e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.737505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf825f4e-e8ec-4b38-9e97-a0886e0c0e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.737775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf825f4e-e8ec-4b38-9e97-a0886e0c0e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.738556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf825f4e-e8ec-4b38-9e97-a0886e0c0e5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:29.738889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf825f4e-e8ec-4b38-9e97-a0886e0c0e5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.741004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf825f4e-e8ec-4b38-9e97-a0886e0c0e5f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.757305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 425/849] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:29.759228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:29.769484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca710f-2364-43cb-9672-d501918d4315 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:29.774082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad656b53-384d-413c-bb80-b23fa870e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:29.774702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656b53-384d-413c-bb80-b23fa870e59f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:29.775012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656b53-384d-413c-bb80-b23fa870e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:29.775281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656b53-384d-413c-bb80-b23fa870e59f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:29.776117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad656b53-384d-413c-bb80-b23fa870e59f admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=c1d552a7c37744e1b7b61a33d34ceedb) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:29.776419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad656b53-384d-413c-bb80-b23fa870e59f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:29.778299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad656b53-384d-413c-bb80-b23fa870e59f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:29.784765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 425/850] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:29 2022] GET /identity/v3/role_assignments?user.id=c1d552a7c37744e1b7b61a33d34ceedb&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:30.066585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31c2de-6cc0-4002-a36a-1266ad53d6f7 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.067097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31c2de-6cc0-4002-a36a-1266ad53d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.067484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31c2de-6cc0-4002-a36a-1266ad53d6f7 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.069607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 426/851] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:30.075667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d61bd-79f1-4e9b-8964-7becd14b88a2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.075952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d61bd-79f1-4e9b-8964-7becd14b88a2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.076225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d61bd-79f1-4e9b-8964-7becd14b88a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.095436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5a7d61bd-79f1-4e9b-8964-7becd14b88a2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:30.096687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5a7d61bd-79f1-4e9b-8964-7becd14b88a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:30.110891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 426/852] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:30 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:30.129360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31c2de-6cc0-4002-a36a-1266ad53d6f7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.143069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31c2de-6cc0-4002-a36a-1266ad53d6f7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.147956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.149302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.149588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.149906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.161207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:30.169795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:30.175032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 427/853] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:30.177918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d61bd-79f1-4e9b-8964-7becd14b88a2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.188479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d61bd-79f1-4e9b-8964-7becd14b88a2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.194271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.194971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.195249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.195520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.196465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.196999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.198819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.214919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 427/854] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:30.216896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.231759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435827d5-4d7d-4c5a-9831-3f6dce1dc43a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.236984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.237819 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.238095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.238363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.254055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.256121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.278638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:30.283458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 428/855] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:30.286133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.296919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0ca5-e24d-4fdf-bcb2-42423c2efdaa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.301534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.302183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.302460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.302774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.303538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.303889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.305737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.321170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 428/856] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:30.326272 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.337146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9511c02-147e-45e7-8b2e-398e47511293 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.341978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.342823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.343119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.343392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.351237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.353357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.367395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 31 04:26:30.368894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 429/857] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:30.374578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.385105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3761e-1bb4-4ed2-8e27-42fbbf10f5cc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.389831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.390494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.390764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.391066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.392136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.392448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.394499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.414074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 429/858] 10.222.0.21 () {56 vars in 1156 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:30.421259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.432810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28081ec-6d68-4eae-ad5f-7308db1d6ccb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.439214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.440277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.440760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.441431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.451676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.454591 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.465867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 430/859] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:30.471943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.484652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1bc4-f289-4451-ba38-7ef8833127c1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.489492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.490567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.491068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.491541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.502836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.505012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.522907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:30.525107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 430/860] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:30.531318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.542737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0ae2d-8a65-497b-8fb4-59ff8a47cde2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.548067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.549021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.549507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.550096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.551080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.551607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.553408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.568095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 431/861] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:30.576368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.589047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32309f-0152-4e3b-9b0a-9619c089de7d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.593880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.594722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.595038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.595311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.603114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.605073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.618372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:30.619952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 431/862] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:30.625516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.636499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55febdc-e0a8-4ad4-853c-b89910928014 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.641434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512a0ce-789c-4778-9a73-451aec6e8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.642363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a0ce-789c-4778-9a73-451aec6e8149 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.642876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a0ce-789c-4778-9a73-451aec6e8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.643351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a0ce-789c-4778-9a73-451aec6e8149 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.644345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512a0ce-789c-4778-9a73-451aec6e8149 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.644848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512a0ce-789c-4778-9a73-451aec6e8149 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.646943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512a0ce-789c-4778-9a73-451aec6e8149 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.661162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 432/863] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:30.668086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.678997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccc442-603d-4d0c-8507-bd3b986ab002 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.684485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045e296-34da-4295-b7cf-cd460bc6dc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.685408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045e296-34da-4295-b7cf-cd460bc6dc3f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.685904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045e296-34da-4295-b7cf-cd460bc6dc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.686378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045e296-34da-4295-b7cf-cd460bc6dc3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.687451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045e296-34da-4295-b7cf-cd460bc6dc3f admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=77321e9c7ec34370b1b8246dde35911b) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.687965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045e296-34da-4295-b7cf-cd460bc6dc3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.690039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045e296-34da-4295-b7cf-cd460bc6dc3f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.697648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 432/864] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/role_assignments?user.id=77321e9c7ec34370b1b8246dde35911b&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:30.709069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed399fb4-aa5b-4433-ae5a-c3c2ba3714ea None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.709392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed399fb4-aa5b-4433-ae5a-c3c2ba3714ea None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.709622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed399fb4-aa5b-4433-ae5a-c3c2ba3714ea None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.711885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 433/865] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:30.717840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915cea-3302-47b5-b496-245188dd37aa None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.718139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915cea-3302-47b5-b496-245188dd37aa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.718406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915cea-3302-47b5-b496-245188dd37aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.737583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2c915cea-3302-47b5-b496-245188dd37aa None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:30.738823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2c915cea-3302-47b5-b496-245188dd37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:30.747695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 433/866] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:30 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:30.771548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed399fb4-aa5b-4433-ae5a-c3c2ba3714ea None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.785408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed399fb4-aa5b-4433-ae5a-c3c2ba3714ea None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.787939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13fa3-0ec1-439f-a6a2-c014d22dcd1e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.788224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13fa3-0ec1-439f-a6a2-c014d22dcd1e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.788501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13fa3-0ec1-439f-a6a2-c014d22dcd1e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.790239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.791025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.791311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.791666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.792396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.794239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.794923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 434/867] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:30.796307 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd7ab-c406-475c-9179-1ae6f3d45f67 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.796592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd7ab-c406-475c-9179-1ae6f3d45f67 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.797140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd7ab-c406-475c-9179-1ae6f3d45f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.817306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-770fd7ab-c406-475c-9179-1ae6f3d45f67 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:30.818591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-770fd7ab-c406-475c-9179-1ae6f3d45f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:30.827052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 435/868] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:30 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:30.850661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd7ab-c406-475c-9179-1ae6f3d45f67 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.862041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd7ab-c406-475c-9179-1ae6f3d45f67 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.865091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 434/869] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:30 2022] POST /identity/v3/services => generated 269 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:30.882693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.883768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.884236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.884518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.885204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.887079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.901271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 31 04:26:30.902859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 436/870] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:30.909274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.921752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c621-b104-4c4a-86c0-ba192238788c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.927545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae120eec-e877-4c9e-b545-6c712d584696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.928187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120eec-e877-4c9e-b545-6c712d584696 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.928468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120eec-e877-4c9e-b545-6c712d584696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.928741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120eec-e877-4c9e-b545-6c712d584696 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.929472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae120eec-e877-4c9e-b545-6c712d584696 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.929771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae120eec-e877-4c9e-b545-6c712d584696 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.932082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae120eec-e877-4c9e-b545-6c712d584696 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.937731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 435/871] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:30.943181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:30.956561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb30abc-ceac-40ee-89ce-5028434367f0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:30.962825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6b5db-957a-4bd6-b982-dd5da1d37b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:30.963528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6b5db-957a-4bd6-b982-dd5da1d37b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:30.963813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6b5db-957a-4bd6-b982-dd5da1d37b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:30.964088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6b5db-957a-4bd6-b982-dd5da1d37b70 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:30.964817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6b5db-957a-4bd6-b982-dd5da1d37b70 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:30.965118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6b5db-957a-4bd6-b982-dd5da1d37b70 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:30.966726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6b5db-957a-4bd6-b982-dd5da1d37b70 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:30.972249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 437/872] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:32.201076 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec69dd-1db0-4c95-95ab-d57b3428378f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.201775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec69dd-1db0-4c95-95ab-d57b3428378f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.201775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec69dd-1db0-4c95-95ab-d57b3428378f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.203627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 436/873] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:32.209037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2b5d-af09-43c1-9c01-5b5464f02772 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.209505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2b5d-af09-43c1-9c01-5b5464f02772 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.209677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2b5d-af09-43c1-9c01-5b5464f02772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.228415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-dc6e2b5d-af09-43c1-9c01-5b5464f02772 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:32.229579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-dc6e2b5d-af09-43c1-9c01-5b5464f02772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:32.243035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 438/874] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:32 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:32.261706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec69dd-1db0-4c95-95ab-d57b3428378f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.274045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec69dd-1db0-4c95-95ab-d57b3428378f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.278366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.279205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.279479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.279746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.290119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:32.297287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 31 04:26:32.302893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 437/875] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:32.304318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2b5d-af09-43c1-9c01-5b5464f02772 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.314237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2b5d-af09-43c1-9c01-5b5464f02772 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.318658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.319330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.319607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.319877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.320689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:32.320991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.322567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.334952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 439/876] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:32.337149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.347477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1912a-136e-4fbc-9531-82098d383b01 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.352480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.353400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.353671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.353933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.364079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.366198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.382991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:32.389108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 438/877] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:32.390467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.400835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ca42-b5bf-408e-8a49-36e9d6c76a1d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.405445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.406130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.406674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.406979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.407767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:32.408060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.409765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.426442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 440/878] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:32.427817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.438558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecb49e-a83d-4440-882f-3612c81c26cf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.443236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.444057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.444367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.444641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.452577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.454655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.469794 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 31 04:26:32.474907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 439/879] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:32.476976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.486998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524241-094e-4cfd-9be3-551c06058a65 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.491658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.492312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.493196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.493468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.494299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:32.494606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.496544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.518933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 441/880] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:32.520313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.531095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d81fe-3ea7-40dc-be07-ee84f867a424 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.536316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.536998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.537274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.537540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.548276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.550090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.564303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 440/881] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:32.565694 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.576285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510bfb-9c43-486f-bdc5-0ddda0d89569 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.580884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.581710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.581988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.582307 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.593832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.595671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.613462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:32.618876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 442/882] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:32.620607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.629696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56995a-0cbe-4841-9b7a-30bc55107f85 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.634979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.635612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.635888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.636158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.636941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:32.637235 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.638943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.654916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 441/883] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:32.656934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.667882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea52341-2165-401b-916f-2c822fcae8b9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.672635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.673464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.673740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.674046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.681610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.683645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.697620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:32.703163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 443/884] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:32.704901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.715129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457fdb3-cd80-4633-a6b5-0da4146b5852 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.719850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed82700-05c5-4d9d-bd15-f621c685a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.720592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed82700-05c5-4d9d-bd15-f621c685a745 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.720871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed82700-05c5-4d9d-bd15-f621c685a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.721142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed82700-05c5-4d9d-bd15-f621c685a745 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.721981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed82700-05c5-4d9d-bd15-f621c685a745 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:32.722282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed82700-05c5-4d9d-bd15-f621c685a745 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.724207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed82700-05c5-4d9d-bd15-f621c685a745 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.742924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 442/885] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:32.745414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:32.756048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108bde-c400-4848-a7e2-9e374562ee55 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:32.761381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86f401-2b04-456d-a2ba-fc6f1b6d955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:32.762066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86f401-2b04-456d-a2ba-fc6f1b6d955a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:32.762341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86f401-2b04-456d-a2ba-fc6f1b6d955a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:32.762659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86f401-2b04-456d-a2ba-fc6f1b6d955a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:32.763632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86f401-2b04-456d-a2ba-fc6f1b6d955a admin admin] RBAC: Adding query filter params (role.id=010bf58c112e401993fcc162d4eb9125, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=c1d552a7c37744e1b7b61a33d34ceedb) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:32.763936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86f401-2b04-456d-a2ba-fc6f1b6d955a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:32.765820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86f401-2b04-456d-a2ba-fc6f1b6d955a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:32.778982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 444/886] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:32 2022] GET /identity/v3/role_assignments?user.id=c1d552a7c37744e1b7b61a33d34ceedb&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=010bf58c112e401993fcc162d4eb9125 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:33.123185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e9ba-3dbf-4322-8a93-ee9c7b00ac3d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.123503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e9ba-3dbf-4322-8a93-ee9c7b00ac3d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.123764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26e9ba-3dbf-4322-8a93-ee9c7b00ac3d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.125786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 443/887] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:33.131281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff75f2-66ae-46f3-87a2-5d08fb589774 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.131574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff75f2-66ae-46f3-87a2-5d08fb589774 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.131854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff75f2-66ae-46f3-87a2-5d08fb589774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.150757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d8ff75f2-66ae-46f3-87a2-5d08fb589774 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:33.152000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d8ff75f2-66ae-46f3-87a2-5d08fb589774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:33.160343 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 445/888] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:33 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:33.185389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26e9ba-3dbf-4322-8a93-ee9c7b00ac3d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.198448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26e9ba-3dbf-4322-8a93-ee9c7b00ac3d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.202909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.203692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.203971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.204245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.204906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.206502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.217907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 31 04:26:33.219375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 444/889] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:33.225302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff75f2-66ae-46f3-87a2-5d08fb589774 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.234375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff75f2-66ae-46f3-87a2-5d08fb589774 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.238991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba4e47-04da-4582-b50a-fd17865a7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.239641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba4e47-04da-4582-b50a-fd17865a7f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.239924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba4e47-04da-4582-b50a-fd17865a7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.240196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba4e47-04da-4582-b50a-fd17865a7f1f admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.240920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba4e47-04da-4582-b50a-fd17865a7f1f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:33.241221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba4e47-04da-4582-b50a-fd17865a7f1f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.243453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba4e47-04da-4582-b50a-fd17865a7f1f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.248529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 446/890] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:33.254081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.265535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb718cd-56e9-49ec-9b7c-ad73d79059c1 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.265535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb718cd-56e9-49ec-9b7c-ad73d79059c1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.265930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc13664-80d2-487f-bc47-666608d2d8f2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.266083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb718cd-56e9-49ec-9b7c-ad73d79059c1 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.267385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 447/891] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:33.272778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876196-b853-45f0-9e94-df529621138c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.273061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876196-b853-45f0-9e94-df529621138c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.273806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7876196-b853-45f0-9e94-df529621138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.276664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56578ced-1200-471d-b3e0-6c62f2941908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.277695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56578ced-1200-471d-b3e0-6c62f2941908 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.278186 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56578ced-1200-471d-b3e0-6c62f2941908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.278831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56578ced-1200-471d-b3e0-6c62f2941908 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.279763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56578ced-1200-471d-b3e0-6c62f2941908 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:33.280295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56578ced-1200-471d-b3e0-6c62f2941908 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.282390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56578ced-1200-471d-b3e0-6c62f2941908 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.287524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 445/892] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:33.288935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc6ef4-6614-44c9-b14b-21e2bb922cac None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.289754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc6ef4-6614-44c9-b14b-21e2bb922cac None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.290004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc6ef4-6614-44c9-b14b-21e2bb922cac None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.294084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 446/893] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:33.295260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d7876196-b853-45f0-9e94-df529621138c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:33.296475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d7876196-b853-45f0-9e94-df529621138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:33.303025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4c20-a46e-4167-bf67-cd6cbb57685d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.303329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4c20-a46e-4167-bf67-cd6cbb57685d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.303572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4c20-a46e-4167-bf67-cd6cbb57685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.308166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 448/894] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:33 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:33.324714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-31de4c20-a46e-4167-bf67-cd6cbb57685d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:33.325908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-31de4c20-a46e-4167-bf67-cd6cbb57685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:33.334022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876196-b853-45f0-9e94-df529621138c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.334391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 447/895] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:33 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:33.344967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7876196-b853-45f0-9e94-df529621138c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.350072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.351361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.352401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.353073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.354141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.356055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.360803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de4c20-a46e-4167-bf67-cd6cbb57685d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.369481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 31 04:26:33.370737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de4c20-a46e-4167-bf67-cd6cbb57685d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.371706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 449/896] 10.222.0.21 () {56 vars in 1153 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:33.377776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.378384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.379088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.379414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.379685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.380484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.382222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.390843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044722d-1967-494d-85e8-e2a6c90ce056 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.395899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.396562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.399263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.399263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.399263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:33.399263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.400174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.405555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 450/897] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:33.411336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.422511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63543-eafc-4a33-87f5-0b69cf866af0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.427115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.427773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.428122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.428324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.429046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:33.429347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.431992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.438024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 451/898] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:33.443838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.454289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c1609-d59e-4cd4-bf78-bb32e0af48f8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.463898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 448/899] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:33 2022] POST /identity/v3/services => generated 251 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:33.478407 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93eee92-e8ac-42bb-b494-55698744d654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.479590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eee92-e8ac-42bb-b494-55698744d654 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.479590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eee92-e8ac-42bb-b494-55698744d654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.479755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93eee92-e8ac-42bb-b494-55698744d654 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.480485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93eee92-e8ac-42bb-b494-55698744d654 admin admin] RBAC: Adding query filter params (interface=public, service_id=b3317b7153ef41b8b61b645896846506, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:33.480791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93eee92-e8ac-42bb-b494-55698744d654 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.482485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93eee92-e8ac-42bb-b494-55698744d654 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.488610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 452/900] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/endpoints?service_id=b3317b7153ef41b8b61b645896846506&interface=public®ion_id=RegionOne => generated 194 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:33.495383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:33.508572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efde184-3b61-4971-ae94-0037deb98f74 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:33.518022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df271f72-5043-4d62-ae66-9f31911d55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:33.518826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df271f72-5043-4d62-ae66-9f31911d55d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:33.519169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df271f72-5043-4d62-ae66-9f31911d55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:33.522864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df271f72-5043-4d62-ae66-9f31911d55d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:33.522864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df271f72-5043-4d62-ae66-9f31911d55d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:33.522864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df271f72-5043-4d62-ae66-9f31911d55d9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:33.529655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 449/901] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:33 2022] GET /identity/v3/services => generated 1268 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:26:34.996590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9fbc-a87a-4ccd-ab68-6debb5c448c6 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:34.997106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9fbc-a87a-4ccd-ab68-6debb5c448c6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:34.997106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9fbc-a87a-4ccd-ab68-6debb5c448c6 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:34.999154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 453/902] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:35.004328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09768fb-fc46-4a23-b46d-a1144a6d756c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.004722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09768fb-fc46-4a23-b46d-a1144a6d756c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.004886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09768fb-fc46-4a23-b46d-a1144a6d756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.023261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c09768fb-fc46-4a23-b46d-a1144a6d756c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:35.024492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c09768fb-fc46-4a23-b46d-a1144a6d756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:35.038892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 450/903] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:35 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:35.056146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9fbc-a87a-4ccd-ab68-6debb5c448c6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.068187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b9fbc-a87a-4ccd-ab68-6debb5c448c6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.073252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.074037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.074310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.074574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.088016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:35.095211 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 31 04:26:35.101200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 454/904] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:35.103100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09768fb-fc46-4a23-b46d-a1144a6d756c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.112040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09768fb-fc46-4a23-b46d-a1144a6d756c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.116592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.117236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.117566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.117837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.118587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.118920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.120497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.130885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 451/905] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:35.135172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.145050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27679-412a-436d-a730-18c0739d9c4a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.149757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.150528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.150814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.151093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.161724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.163594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.185274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:35.187131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 455/906] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:35.192604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.202934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3f0c2-9db9-4880-b357-40173bc913a8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.207525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.208169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.208441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.208709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.209563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.209860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.212127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.228583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 452/907] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:35.229923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.245157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df86c6-087f-4039-8e65-d40567ebab3c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.249985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.250834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.251202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.251548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.259465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.261566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.276596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 31 04:26:35.278065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 456/908] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:35.283950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.294134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503be4a-4b05-415c-9e84-fc3214688b99 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.298825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.299717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.300139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.300586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.301563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.302003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.303984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.326883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 453/909] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:35.328926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.339912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462826bb-72a5-4312-bc24-16b96f8124b2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.345093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.346218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.346637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.347075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.358970 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.361169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.380342 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:35.386497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 457/910] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:35.388041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.398300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212672d-e9e0-4f23-a1dc-af077d8e26e9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.403569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.404430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.404886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.405294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.406152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.406861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.408653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.425006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 454/911] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:35.426600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.441258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb6293-3519-463a-904d-0696bcad790c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.446242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.447226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.447610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.448042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.455705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.457830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.471910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:35.473415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 458/912] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:35.480071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.490844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8afb0-6900-4757-94a0-0a6328973502 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.496535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a70ff-ed4f-4830-8197-72105c751dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.497559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a70ff-ed4f-4830-8197-72105c751dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.497848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a70ff-ed4f-4830-8197-72105c751dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.498126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a70ff-ed4f-4830-8197-72105c751dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.499155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a70ff-ed4f-4830-8197-72105c751dbf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.499468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a70ff-ed4f-4830-8197-72105c751dbf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.501552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a70ff-ed4f-4830-8197-72105c751dbf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.516884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 455/913] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:35.523903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.535255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028e21-6891-4162-8350-a0bfce737e67 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.540773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3429f1-c081-4a6b-9210-0b32baca9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.541962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3429f1-c081-4a6b-9210-0b32baca9899 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.542434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3429f1-c081-4a6b-9210-0b32baca9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.542947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3429f1-c081-4a6b-9210-0b32baca9899 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/c1d552a7c37744e1b7b61a33d34ceedb/roles/010bf58c112e401993fcc162d4eb9125` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.545578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3429f1-c081-4a6b-9210-0b32baca9899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=c1d552a7c37744e1b7b61a33d34ceedb, role_id=010bf58c112e401993fcc162d4eb9125)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.548641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3429f1-c081-4a6b-9210-0b32baca9899 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.595370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7565f-58ab-428d-8153-24c18e109574 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.595664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7565f-58ab-428d-8153-24c18e109574 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.595924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7565f-58ab-428d-8153-24c18e109574 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.597853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 456/914] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:35.603380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19d4c-18bd-440f-84c5-35395d8e386a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.603664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19d4c-18bd-440f-84c5-35395d8e386a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.603937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19d4c-18bd-440f-84c5-35395d8e386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.622700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-90d19d4c-18bd-440f-84c5-35395d8e386a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:35.623901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-90d19d4c-18bd-440f-84c5-35395d8e386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:35.634907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 457/915] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:35 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:35.658923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19d4c-18bd-440f-84c5-35395d8e386a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.659358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 459/916] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:35 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/c1d552a7c37744e1b7b61a33d34ceedb/roles/010bf58c112e401993fcc162d4eb9125 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:35.666489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19d4c-18bd-440f-84c5-35395d8e386a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.732001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.732682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.732953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.733222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.733972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.735721 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.744775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a62c5-e0f3-43e2-aa3f-471efb39846b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.745064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a62c5-e0f3-43e2-aa3f-471efb39846b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.745472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a62c5-e0f3-43e2-aa3f-471efb39846b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.747538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 460/917] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:35.754904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264eb0-1219-4b5d-b52b-8e2d83d4ceab None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.754904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264eb0-1219-4b5d-b52b-8e2d83d4ceab None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.754904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18264eb0-1219-4b5d-b52b-8e2d83d4ceab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.773901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-18264eb0-1219-4b5d-b52b-8e2d83d4ceab None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:35.775322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-18264eb0-1219-4b5d-b52b-8e2d83d4ceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:35.783601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 461/918] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:35 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:35.810812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18264eb0-1219-4b5d-b52b-8e2d83d4ceab None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.813932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 458/919] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:35 2022] POST /identity/v3/services => generated 241 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:26:35.822425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18264eb0-1219-4b5d-b52b-8e2d83d4ceab None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.840046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fdd35-d1d6-4f56-be8a-fa124192d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.841187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fdd35-d1d6-4f56-be8a-fa124192d14a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.841651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fdd35-d1d6-4f56-be8a-fa124192d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.842123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fdd35-d1d6-4f56-be8a-fa124192d14a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.843032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fdd35-d1d6-4f56-be8a-fa124192d14a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.845038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fdd35-d1d6-4f56-be8a-fa124192d14a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.858539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-305fdd35-d1d6-4f56-be8a-fa124192d14a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 31 04:26:35.860349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 462/920] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:35.866712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.880381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7e325-85f9-4cf1-b333-06f2e02e9941 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.886943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.887617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.887888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.888160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.888891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.889192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.890921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.902376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 459/921] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:35.906711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773e0e-321a-4a03-b325-31910b302a1c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.907064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773e0e-321a-4a03-b325-31910b302a1c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.907348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff773e0e-321a-4a03-b325-31910b302a1c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.909317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 463/922] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:35.913474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.916471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9f56-dfc3-4a1b-ad38-93c9da4dd5b5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.917039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9f56-dfc3-4a1b-ad38-93c9da4dd5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.917517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9f56-dfc3-4a1b-ad38-93c9da4dd5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.924944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9907-aaf3-40a7-beef-50da6221d729 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.931521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.932190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.932471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.932745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.933473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.933778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.936496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.942054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7aae9f56-dfc3-4a1b-ad38-93c9da4dd5b5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:35.942399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 460/923] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:35.943830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7aae9f56-dfc3-4a1b-ad38-93c9da4dd5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:35.949431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.953812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 464/924] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:35 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:35.960976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d92fb-83d0-4ea0-b0df-da222fbc2365 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.967249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.967966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.968294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.968568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.969434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] RBAC: Adding query filter params (interface=public, service_id=e95cf48de43a41c1bfa2bf8dd7a80974, region_id=RegionOne) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:35.969781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:35.970845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:26:35.970845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:26:35.970845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:26:35.971844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:35.981197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9f56-dfc3-4a1b-ad38-93c9da4dd5b5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.981790 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 461/925] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/endpoints?service_id=e95cf48de43a41c1bfa2bf8dd7a80974&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:35.987264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:35.992950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9f56-dfc3-4a1b-ad38-93c9da4dd5b5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.997590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:35.998389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:35.998674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:35.998982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:35.999160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533a8c6-fe93-410e-bd1d-9ae0b844d232 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:35.999858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:36.001426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:36.003672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:36.004318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:36.004599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:36.005139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:36.005551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:36.007231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:36.014884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 462/926] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:26:36.015009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 31 04:26:36.016131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 465/927] 10.222.0.21 () {56 vars in 1153 bytes} [Mon Jan 31 04:26:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:36.022149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:36.033166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b952ae4-5c50-470a-bfee-c2e201dd930f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:36.038981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:36.039722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:36.040004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:36.040281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:36.041019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:36.041327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:36.043028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:36.048948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 463/928] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:36.055295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:36.067697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81af6c-ce02-45b3-8330-cc96ac1695d4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:36.073353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f291e08-66ff-4443-82d3-387e91052c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:36.074023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291e08-66ff-4443-82d3-387e91052c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:36.074305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291e08-66ff-4443-82d3-387e91052c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:36.074577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f291e08-66ff-4443-82d3-387e91052c46 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:36.075347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f291e08-66ff-4443-82d3-387e91052c46 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:36.075654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f291e08-66ff-4443-82d3-387e91052c46 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:36.077299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f291e08-66ff-4443-82d3-387e91052c46 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:36.087487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 466/929] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:36.093678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:36.105582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d7fe5-ad30-43c3-9f54-ad370611991e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:36.111253 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb715f67-5866-4b3f-a56c-4fa29ae4fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:36.112067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb715f67-5866-4b3f-a56c-4fa29ae4fec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:36.112421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb715f67-5866-4b3f-a56c-4fa29ae4fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:36.112766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb715f67-5866-4b3f-a56c-4fa29ae4fec0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:36.113685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb715f67-5866-4b3f-a56c-4fa29ae4fec0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:36.115576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb715f67-5866-4b3f-a56c-4fa29ae4fec0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:36.194394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 464/930] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:38.041112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3adcf-4dfd-44a4-8380-3a9bc30b26e3 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.041648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3adcf-4dfd-44a4-8380-3a9bc30b26e3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.041939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3adcf-4dfd-44a4-8380-3a9bc30b26e3 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.045305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 467/931] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:38.051580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0d4b-e1fa-4245-83cd-d831670ed17e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.052022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0d4b-e1fa-4245-83cd-d831670ed17e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.052364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0d4b-e1fa-4245-83cd-d831670ed17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.073787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ccdc0d4b-e1fa-4245-83cd-d831670ed17e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:38.074991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ccdc0d4b-e1fa-4245-83cd-d831670ed17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:38.098875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 465/932] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:38 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:38.128502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3adcf-4dfd-44a4-8380-3a9bc30b26e3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.141757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3adcf-4dfd-44a4-8380-3a9bc30b26e3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.146497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.147533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.147985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.148551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.160195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:38.168148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 31 04:26:38.169822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 468/933] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:38.175755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0d4b-e1fa-4245-83cd-d831670ed17e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.185998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0d4b-e1fa-4245-83cd-d831670ed17e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.190918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.191883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.192331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.192772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.193712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.194195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.196746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.207276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 466/934] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.213456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.224026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57bde2-fb97-4aff-b634-9f3d9262f109 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.229072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.230696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.230696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.231026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.242069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.244899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.262542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:38.264410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 469/935] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:38.270154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.281448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3b437-4d51-42d0-9bd6-013457d18cbf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.286262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ca954-b182-4aa8-911e-160278fb7a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.287216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca954-b182-4aa8-911e-160278fb7a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.287669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca954-b182-4aa8-911e-160278fb7a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.288139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca954-b182-4aa8-911e-160278fb7a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.289295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ca954-b182-4aa8-911e-160278fb7a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.289953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ca954-b182-4aa8-911e-160278fb7a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.292002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ca954-b182-4aa8-911e-160278fb7a5f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.310962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 467/936] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.312962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.325009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c8f3-2898-48e3-bc2b-0bda70bad97c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.330341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.331410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.331862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.332303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.340997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.343255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.357198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f7d65-e82b-48ab-8a6c-109683249f4e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.357468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f7d65-e82b-48ab-8a6c-109683249f4e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.362462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f7d65-e82b-48ab-8a6c-109683249f4e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.362462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 468/937] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:38.362669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 31 04:26:38.362669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 470/938] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:38.368698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60dd4-1c8a-4277-b30d-b65e24026f75 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.368982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60dd4-1c8a-4277-b30d-b65e24026f75 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.369243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.369345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a60dd4-1c8a-4277-b30d-b65e24026f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.379315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d7ab9-5fa9-40a0-bf55-beed25ecaedc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.387740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-31a60dd4-1c8a-4277-b30d-b65e24026f75 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:38.388018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.388905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.389010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-31a60dd4-1c8a-4277-b30d-b65e24026f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:38.389492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.389955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.391024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.391525 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.393547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.406824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 469/939] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:38 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:38.418127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 471/940] 10.222.0.21 () {56 vars in 1170 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.423644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a60dd4-1c8a-4277-b30d-b65e24026f75 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.427769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.433568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a60dd4-1c8a-4277-b30d-b65e24026f75 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.438163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406a37-eea2-4125-9916-c86865b79f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.438815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406a37-eea2-4125-9916-c86865b79f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.439100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406a37-eea2-4125-9916-c86865b79f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.439370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406a37-eea2-4125-9916-c86865b79f3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.440334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f01b30-b6cb-48b2-a491-dd343fc8e09d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.445295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252a88d-26ff-4a5b-89ae-b4283dd9797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.447002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252a88d-26ff-4a5b-89ae-b4283dd9797a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.447523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252a88d-26ff-4a5b-89ae-b4283dd9797a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.447707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406a37-eea2-4125-9916-c86865b79f3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.448174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252a88d-26ff-4a5b-89ae-b4283dd9797a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.449223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252a88d-26ff-4a5b-89ae-b4283dd9797a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.449548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406a37-eea2-4125-9916-c86865b79f3b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.451308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252a88d-26ff-4a5b-89ae-b4283dd9797a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.459240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 470/941] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:38.464143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c96b6-705b-4d31-8abb-3578e472fd95 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.464484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c96b6-705b-4d31-8abb-3578e472fd95 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.464759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c96b6-705b-4d31-8abb-3578e472fd95 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.466573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 471/942] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:38.467722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3252a88d-26ff-4a5b-89ae-b4283dd9797a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 31 04:26:38.469187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 472/943] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:38.473977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c96b6-705b-4d31-8abb-3578e472fd95 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.474097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8b650-c66a-48a1-8e6a-e12b5906cd51 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.474097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8b650-c66a-48a1-8e6a-e12b5906cd51 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.474097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8b650-c66a-48a1-8e6a-e12b5906cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.483067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c96b6-705b-4d31-8abb-3578e472fd95 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.487434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.488188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.488460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.488730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.493921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cec8b650-c66a-48a1-8e6a-e12b5906cd51 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:38.495129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cec8b650-c66a-48a1-8e6a-e12b5906cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:38.499917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.501737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.506454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 473/944] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:38 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:38.507492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8b650-c66a-48a1-8e6a-e12b5906cd51 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.517606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8b650-c66a-48a1-8e6a-e12b5906cd51 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.521739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:38.522453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.523274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 472/945] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:38.523758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.524384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.524822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.525715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.526179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.528094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.529292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.533665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 474/946] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.534632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.540662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4394f9-d21b-49e1-9ad7-23c0464d033c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.547978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edff126-6b44-4b50-83c1-142b91db3d38 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.548108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.548108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.548108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.548108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.548355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.548355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.549283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.550077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c21b8-063c-4285-95c7-d344bb48b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.550869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c21b8-063c-4285-95c7-d344bb48b7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.551154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c21b8-063c-4285-95c7-d344bb48b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.551424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c21b8-063c-4285-95c7-d344bb48b7f0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.552076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c21b8-063c-4285-95c7-d344bb48b7f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.553633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c21b8-063c-4285-95c7-d344bb48b7f0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.561623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 473/947] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.562442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.566367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-8c3c21b8-063c-4285-95c7-d344bb48b7f0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 31 04:26:38.567583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 475/948] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:38.568787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3dd7-e071-494a-888a-803e46e97487 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.569078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3dd7-e071-494a-888a-803e46e97487 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.569349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c3dd7-e071-494a-888a-803e46e97487 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.573866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 476/949] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:38.573866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c3dd7-e071-494a-888a-803e46e97487 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.574026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7f548-0250-430e-a543-f02c469c9662 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.577910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.578556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.578860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.579137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.579850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.580151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.581749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.584565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c3dd7-e071-494a-888a-803e46e97487 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.586751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 474/950] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.587417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.593988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.594812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.599679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.599679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.599860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0153a-bc36-4983-b735-c3f1a9f11086 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.600998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73b8b-eada-4359-ab81-7006923313e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.602181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73b8b-eada-4359-ab81-7006923313e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.602457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73b8b-eada-4359-ab81-7006923313e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.602735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73b8b-eada-4359-ab81-7006923313e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.603472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73b8b-eada-4359-ab81-7006923313e6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.603728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.603814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73b8b-eada-4359-ab81-7006923313e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.605385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf73b8b-eada-4359-ab81-7006923313e6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.605782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.610037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 475/951] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.611217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a1e9c-6b03-440c-9048-1a582e99f0d1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.611502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a1e9c-6b03-440c-9048-1a582e99f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.611776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a1e9c-6b03-440c-9048-1a582e99f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.620045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:38.621326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 477/952] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:38.621959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.630858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-060a1e9c-6b03-440c-9048-1a582e99f0d1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:38.631258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa76533-eefd-400d-b227-ab61c98a845b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.632062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-060a1e9c-6b03-440c-9048-1a582e99f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:38.636833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.637442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.637720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.637992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.638781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] RBAC: Adding query filter params (interface=public, service_id=923cd871011e40e2aa886c0901ab40e3, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.639119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.640170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 476/953] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:38 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:38.640821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.643606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a1e9c-6b03-440c-9048-1a582e99f0d1 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.651167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 478/954] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/endpoints?service_id=923cd871011e40e2aa886c0901ab40e3&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.651167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.653946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a1e9c-6b03-440c-9048-1a582e99f0d1 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.657453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83e36-c754-48a0-8179-ce3387d2d3aa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.658775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.659447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.659724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.659996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.660710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.661047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.662114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.662592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.662730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.668607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.668607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.668607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.668607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.668607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.669008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 477/955] 10.222.0.21 () {56 vars in 1135 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.669008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.678992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30fcb2-7a40-46c5-b08d-4b8958189971 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.684711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 479/956] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.684711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.684908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.684908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.684908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.684908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.685566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.687183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.689977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8310a-e402-4764-a310-a5f07f410281 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.693041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 478/957] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:26:38.697106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.697206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.697206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.697206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.697206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.698015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.699159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.704383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5c5d-ff55-4a98-ac79-80fbbe4fdcf8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.708947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a712-1e65-4570-9eda-99e7d2145b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.709605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a712-1e65-4570-9eda-99e7d2145b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.709884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a712-1e65-4570-9eda-99e7d2145b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.710156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a712-1e65-4570-9eda-99e7d2145b05 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.710695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 31 04:26:38.711609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a712-1e65-4570-9eda-99e7d2145b05 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.718720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 480/958] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:38.718934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a712-1e65-4570-9eda-99e7d2145b05 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.719047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.729230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376439-bcde-4af1-9f25-df187bb9756b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.733804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.734468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.740019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.740019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.740019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] RBAC: Adding query filter params (role.id=010bf58c112e401993fcc162d4eb9125, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=c1d552a7c37744e1b7b61a33d34ceedb) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.740019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.740019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.746108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 481/959] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/role_assignments?user.id=c1d552a7c37744e1b7b61a33d34ceedb&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=010bf58c112e401993fcc162d4eb9125 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.747008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.757409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a4637-72c7-4453-8b7a-64d125af4ce5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.763409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.764105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.766210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.766210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.766210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.766210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.767610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.773780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 482/960] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:38.780472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:38.792977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ac9c2-74eb-4680-8d27-476903e73818 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:38.795340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 479/961] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:38.818030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52817d-5746-4c90-8f9c-f9be291263fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:38.818857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52817d-5746-4c90-8f9c-f9be291263fb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:38.819268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52817d-5746-4c90-8f9c-f9be291263fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:38.819612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52817d-5746-4c90-8f9c-f9be291263fb admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:38.820714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52817d-5746-4c90-8f9c-f9be291263fb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:38.821690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52817d-5746-4c90-8f9c-f9be291263fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:38.823653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52817d-5746-4c90-8f9c-f9be291263fb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:38.831085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 483/962] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:40.965622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0990ca-9e72-41b2-ab38-42871497fd5d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:40.966663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0990ca-9e72-41b2-ab38-42871497fd5d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:40.967197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0990ca-9e72-41b2-ab38-42871497fd5d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:40.969402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 480/963] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:40.974929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5100f6-8606-4236-84aa-d976c5a36647 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:40.975737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5100f6-8606-4236-84aa-d976c5a36647 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:40.976229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5100f6-8606-4236-84aa-d976c5a36647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:40.994775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1d5100f6-8606-4236-84aa-d976c5a36647 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:40.996324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1d5100f6-8606-4236-84aa-d976c5a36647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:41.004679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 484/964] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:40 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:41.028333 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0990ca-9e72-41b2-ab38-42871497fd5d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.042059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0990ca-9e72-41b2-ab38-42871497fd5d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.046957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75f14c-7ac8-4c7d-ba25-02769bcf53cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.047978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f14c-7ac8-4c7d-ba25-02769bcf53cd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.048455 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f14c-7ac8-4c7d-ba25-02769bcf53cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.048942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f14c-7ac8-4c7d-ba25-02769bcf53cd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.049802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75f14c-7ac8-4c7d-ba25-02769bcf53cd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.051628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75f14c-7ac8-4c7d-ba25-02769bcf53cd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.063659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-ea75f14c-7ac8-4c7d-ba25-02769bcf53cd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 31 04:26:41.065416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 481/965] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:41.072204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5100f6-8606-4236-84aa-d976c5a36647 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.075324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800996-c086-4ddc-b637-163829b48906 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.075604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800996-c086-4ddc-b637-163829b48906 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.075872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800996-c086-4ddc-b637-163829b48906 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.077719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 482/966] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:41.082769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f83a4-5e0e-48a2-86c2-5eea99bea503 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.083073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f83a4-5e0e-48a2-86c2-5eea99bea503 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.083342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f83a4-5e0e-48a2-86c2-5eea99bea503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.090722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5100f6-8606-4236-84aa-d976c5a36647 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.096412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6593960-03a4-4382-ae1d-a13ca8502389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.097074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593960-03a4-4382-ae1d-a13ca8502389 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.097357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593960-03a4-4382-ae1d-a13ca8502389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.097628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593960-03a4-4382-ae1d-a13ca8502389 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.098358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6593960-03a4-4382-ae1d-a13ca8502389 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:41.098660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6593960-03a4-4382-ae1d-a13ca8502389 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.100285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6593960-03a4-4382-ae1d-a13ca8502389 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.104162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f85f83a4-5e0e-48a2-86c2-5eea99bea503 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:41.105488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f85f83a4-5e0e-48a2-86c2-5eea99bea503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:41.105837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 485/967] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:41.107114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ddde-202f-41a0-b7fa-24f5581e96ef None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.107379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ddde-202f-41a0-b7fa-24f5581e96ef None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.107655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ddde-202f-41a0-b7fa-24f5581e96ef None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.110826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 486/968] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:41.111210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ddde-202f-41a0-b7fa-24f5581e96ef None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.119587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 483/969] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:41 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:41.121132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30f010-7e43-4152-a564-320de7fa6478 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.121614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30f010-7e43-4152-a564-320de7fa6478 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.122106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30f010-7e43-4152-a564-320de7fa6478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.126179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ddde-202f-41a0-b7fa-24f5581e96ef None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.131664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.132305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.132585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.132969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.133710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:41.134015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.136277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.141588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ec30f010-7e43-4152-a564-320de7fa6478 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:41.143043 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ec30f010-7e43-4152-a564-320de7fa6478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:41.146369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 487/970] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:41.147242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.152245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 484/971] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:41 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:41.153181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30f010-7e43-4152-a564-320de7fa6478 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.157624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf40ff-2908-4af4-9233-03a66a10635f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.162382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30f010-7e43-4152-a564-320de7fa6478 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.163164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.163798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.164645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.164923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.165633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.167519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.167698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5a53-4bbc-4e0a-b0e9-5e1a6b6efa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.168313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5a53-4bbc-4e0a-b0e9-5e1a6b6efa2c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.168591 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5a53-4bbc-4e0a-b0e9-5e1a6b6efa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.168862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5a53-4bbc-4e0a-b0e9-5e1a6b6efa2c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.168955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.common [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 31 04:26:41.169599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d5a53-4bbc-4e0a-b0e9-5e1a6b6efa2c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.171236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d5a53-4bbc-4e0a-b0e9-5e1a6b6efa2c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.239355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.sql.core [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 31 04:26:41.239355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 31 04:26:41.239355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [parameters: {'id': '79115cbe737d4c3d8f1e246af8f65880', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 31 04:26:41.239355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79339) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 31 04:26:41.245453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 485/972] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:41.245581 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 79115cbe737d4c3d8f1e246af8f65880.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 79115cbe737d4c3d8f1e246af8f65880. Jan 31 04:26:41.247031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6d52-e3e9-4462-bc14-06654d01a23d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.247156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 488/973] 10.222.0.21 () {60 vars in 1161 bytes} [Mon Jan 31 04:26:41 2022] POST /identity/v3/projects => generated 262 bytes in 100 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:41.247231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6d52-e3e9-4462-bc14-06654d01a23d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.247301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6d52-e3e9-4462-bc14-06654d01a23d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.248639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.251753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 486/974] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:41.254575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32120106-1332-46fe-9e40-c59bd1c98456 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.254905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32120106-1332-46fe-9e40-c59bd1c98456 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.255190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32120106-1332-46fe-9e40-c59bd1c98456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.263643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fcdc-3f41-43eb-917d-24c0c0098bb0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.274804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-32120106-1332-46fe-9e40-c59bd1c98456 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:41.276130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-32120106-1332-46fe-9e40-c59bd1c98456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:41.282282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.283107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.283384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.283660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.284311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.285152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 487/975] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:41 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:41.286152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.287719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32120106-1332-46fe-9e40-c59bd1c98456 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.298273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 31 04:26:41.299565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 489/976] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/services/image => generated 86 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:41.300162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32120106-1332-46fe-9e40-c59bd1c98456 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.305338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.306120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.307142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.307625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.308455 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.316019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7ba90-e7ed-4ef5-b151-1df0f6d9fff8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.316346 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.318350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.320698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.321362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.321640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.321908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.322630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] RBAC: Adding query filter params (name=image) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:41.322966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.324565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.332505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:41.333885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 488/977] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:41.334541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 490/978] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:41.336281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.336486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.347699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c433b5a-9276-4232-8cd8-fce342ff7c48 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.347944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf04d-4869-4e59-bbbb-1178beb337ab admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.352895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.353074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a57f0-fa29-41f1-9758-db06157d650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.353546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a57f0-fa29-41f1-9758-db06157d650a admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.353668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.353853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.353963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a57f0-fa29-41f1-9758-db06157d650a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.354115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a57f0-fa29-41f1-9758-db06157d650a admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.354204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.354817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] RBAC: Adding query filter params (type=image) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:41.354946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a57f0-fa29-41f1-9758-db06157d650a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.355144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.356429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a57f0-fa29-41f1-9758-db06157d650a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.356764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.361841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 491/979] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:41.362665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:41.373146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee015453-7359-494c-b16d-982553a4977d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:41.378376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9072bd-5456-44d6-81c3-1653174f5ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:41.379104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9072bd-5456-44d6-81c3-1653174f5ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:41.379382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9072bd-5456-44d6-81c3-1653174f5ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:41.379651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9072bd-5456-44d6-81c3-1653174f5ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:41.380439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9072bd-5456-44d6-81c3-1653174f5ca4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:41.380740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9072bd-5456-44d6-81c3-1653174f5ca4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:41.382830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9072bd-5456-44d6-81c3-1653174f5ca4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:41.410000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 492/980] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:41.432274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 489/981] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:41 2022] POST /identity/v3/services => generated 242 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:43.531677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3220-f8dd-49b4-bd52-4062f58ecb6f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.532728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3220-f8dd-49b4-bd52-4062f58ecb6f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.533228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3220-f8dd-49b4-bd52-4062f58ecb6f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.535535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 493/982] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:43.541313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c1588-0eb8-4a31-9804-974bf9756b1d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.545777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c1588-0eb8-4a31-9804-974bf9756b1d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.545777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c1588-0eb8-4a31-9804-974bf9756b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.560655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-8e3c1588-0eb8-4a31-9804-974bf9756b1d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:43.562151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8e3c1588-0eb8-4a31-9804-974bf9756b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:43.587175 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 490/983] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:43 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:43.603879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3220-f8dd-49b4-bd52-4062f58ecb6f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.621575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3220-f8dd-49b4-bd52-4062f58ecb6f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.626015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.626811 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.627101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.627371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.628032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.629632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.641386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 31 04:26:43.642881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 494/984] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:43.649610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c1588-0eb8-4a31-9804-974bf9756b1d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.659110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c1588-0eb8-4a31-9804-974bf9756b1d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.663965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd050b-cc4f-42d5-a17b-f5ab9c5dd2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.664871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd050b-cc4f-42d5-a17b-f5ab9c5dd2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.665370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd050b-cc4f-42d5-a17b-f5ab9c5dd2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.665843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd050b-cc4f-42d5-a17b-f5ab9c5dd2a3 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.666767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd050b-cc4f-42d5-a17b-f5ab9c5dd2a3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:43.667314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd050b-cc4f-42d5-a17b-f5ab9c5dd2a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.669090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd050b-cc4f-42d5-a17b-f5ab9c5dd2a3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.678888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 491/985] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:43.681632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.691508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864216a-c707-42ef-b62c-d93d6b3ba9d7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.696435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ae948-3eac-4f11-bb27-3f303a2dd9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.697335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae948-3eac-4f11-bb27-3f303a2dd9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.697807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae948-3eac-4f11-bb27-3f303a2dd9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.698278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae948-3eac-4f11-bb27-3f303a2dd9b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.699291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ae948-3eac-4f11-bb27-3f303a2dd9b0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:43.699807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ae948-3eac-4f11-bb27-3f303a2dd9b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.701572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ae948-3eac-4f11-bb27-3f303a2dd9b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.710027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14210f4-62da-4fca-a1ab-b3f5e0315450 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.710027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14210f4-62da-4fca-a1ab-b3f5e0315450 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.710027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14210f4-62da-4fca-a1ab-b3f5e0315450 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.710027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 492/987] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:43.710601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 495/987] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:43.714370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14210f4-62da-4fca-a1ab-b3f5e0315450 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.716222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ce15-be88-4b16-be97-787d1bee2a1f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.716514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ce15-be88-4b16-be97-787d1bee2a1f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.716791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ce15-be88-4b16-be97-787d1bee2a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.728551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14210f4-62da-4fca-a1ab-b3f5e0315450 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.734607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc453-dc62-42d3-bf04-788963952adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.735286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc453-dc62-42d3-bf04-788963952adf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.735560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc453-dc62-42d3-bf04-788963952adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.735828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc453-dc62-42d3-bf04-788963952adf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.736568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d684ce15-be88-4b16-be97-787d1bee2a1f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:43.736674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc453-dc62-42d3-bf04-788963952adf admin admin] RBAC: Adding query filter params (interface=admin, service_id=923cd871011e40e2aa886c0901ab40e3, region_id=RegionOne) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:43.736914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc453-dc62-42d3-bf04-788963952adf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.738081 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d684ce15-be88-4b16-be97-787d1bee2a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:43.738490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc453-dc62-42d3-bf04-788963952adf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.744913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 493/988] 10.222.0.21 () {56 vars in 1270 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/endpoints?service_id=923cd871011e40e2aa886c0901ab40e3&interface=admin®ion_id=RegionOne => generated 193 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:43.746205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0519-2c69-4143-82ac-3d6f9454622f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.746487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0519-2c69-4143-82ac-3d6f9454622f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.746755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0519-2c69-4143-82ac-3d6f9454622f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.748497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 494/989] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:43.750665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e0519-2c69-4143-82ac-3d6f9454622f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.752425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 496/990] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:43 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:43.754762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3292-e5f2-4b70-9abc-01f69fba125a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.755082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3292-e5f2-4b70-9abc-01f69fba125a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.755356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3292-e5f2-4b70-9abc-01f69fba125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.766705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e0519-2c69-4143-82ac-3d6f9454622f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.772711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.773023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c61e3292-e5f2-4b70-9abc-01f69fba125a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:43.773380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.773661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.773938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.774381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c61e3292-e5f2-4b70-9abc-01f69fba125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:43.774623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.776469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.782409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 497/991] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:43 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:43.782951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 495/992] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/services => generated 1727 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:26:43.783575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.783780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54f6f-ba0a-4924-a0a3-385248754b22 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.784066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54f6f-ba0a-4924-a0a3-385248754b22 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.784346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54f6f-ba0a-4924-a0a3-385248754b22 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.786213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 498/993] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:43.792605 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294b61-39a4-4195-9eb7-08d76014b1a1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.792928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294b61-39a4-4195-9eb7-08d76014b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.793150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7294b61-39a4-4195-9eb7-08d76014b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.799082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0bf6c-baa5-4a12-bac9-f8d2072be3dc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.804342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.805924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.806389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.806882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.807652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.809300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.813756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d7294b61-39a4-4195-9eb7-08d76014b1a1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:43.815119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d7294b61-39a4-4195-9eb7-08d76014b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:43.823253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 499/994] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:43 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:43.828138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294b61-39a4-4195-9eb7-08d76014b1a1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.834109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7294b61-39a4-4195-9eb7-08d76014b1a1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.839035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.839848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.840131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.840405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.841085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.842885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.856341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 31 04:26:43.857653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 500/995] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:43.858417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.869591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b1e2e-246e-4422-8c9e-ac2d59323724 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.874406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.875200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.875480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.875749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.876476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.878323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.918515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 496/996] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:43 2022] POST /identity/v3/services => generated 242 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:43.919389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.939801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.sql.core [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 31 04:26:43.939801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 31 04:26:43.939801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [parameters: {'user_id': '2dd35cf550924e999e447540dac8609b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 31 04:26:43.939801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79339) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 31 04:26:43.942730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cb89f-5082-4ec7-82c7-74c41ea46579 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.947681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 31 04:26:43.947681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 501/997] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:26:43 2022] POST /identity/v3/users => generated 160 bytes in 89 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:43.954521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.955005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.956059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.956059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.956814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.956996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:43.957255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.958904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.967482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681068a1-92b5-480b-9aed-bd4802f44a6b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.968985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 497/998] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:43.972328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.973130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.973411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.973692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.974915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:43.983823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.986189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:43.986428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b34f20-06a4-4356-8080-52461e317aaf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:43.995886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:43.996552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:43.996828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:43.997100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:43.997817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:43.998114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:43.999763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:44.005766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 31 04:26:44.007698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 502/1000] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:44.007839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 498/1000] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:44.011817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:44.013150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:44.022055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e7eb-2ef8-401a-a009-0ad03352da19 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:44.025222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4475cc-a6bb-4faf-8e0f-a950cb437714 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:44.028909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:44.029567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:44.029843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:44.030116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:44.030968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] RBAC: Adding query filter params (interface=public, service_id=82ff6c9b881a426b9d68a7d9ced5817d, region_id=RegionOne) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:44.031529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:44.032574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c70fbf-0dee-42e8-871f-0cbcddc19f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:44.033147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:44.033768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c70fbf-0dee-42e8-871f-0cbcddc19f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:44.034228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c70fbf-0dee-42e8-871f-0cbcddc19f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:44.034995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c70fbf-0dee-42e8-871f-0cbcddc19f7c admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:44.036683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c70fbf-0dee-42e8-871f-0cbcddc19f7c admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:44.037493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c70fbf-0dee-42e8-871f-0cbcddc19f7c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:44.040514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c70fbf-0dee-42e8-871f-0cbcddc19f7c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:44.044206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 499/1001] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:26:44 2022] GET /identity/v3/endpoints?service_id=82ff6c9b881a426b9d68a7d9ced5817d&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:44.045636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:44.056661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bedb92-8198-477a-8f9f-782f1186c895 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:44.063331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e571c-22f1-4275-a697-8f6eba7a6acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:44.063993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e571c-22f1-4275-a697-8f6eba7a6acb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:44.065531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e571c-22f1-4275-a697-8f6eba7a6acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:44.065817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e571c-22f1-4275-a697-8f6eba7a6acb admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:44.066510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e571c-22f1-4275-a697-8f6eba7a6acb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:44.068297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e571c-22f1-4275-a697-8f6eba7a6acb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:44.077848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 500/1002] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:44 2022] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:26:44.105597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 503/1003] 10.222.0.21 () {56 vars in 1122 bytes} [Mon Jan 31 04:26:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:46.087466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48141c25-8c94-4843-871c-24b3b40bf3c2 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.087466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48141c25-8c94-4843-871c-24b3b40bf3c2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.087466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48141c25-8c94-4843-871c-24b3b40bf3c2 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.089944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 501/1004] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:46.094941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15134-55bc-4ac1-9ada-8a1f82d40875 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.095360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15134-55bc-4ac1-9ada-8a1f82d40875 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.095566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd15134-55bc-4ac1-9ada-8a1f82d40875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.113299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2fd15134-55bc-4ac1-9ada-8a1f82d40875 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:46.114853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2fd15134-55bc-4ac1-9ada-8a1f82d40875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:46.123159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 504/1005] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:46 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:46.148746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48141c25-8c94-4843-871c-24b3b40bf3c2 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.161274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48141c25-8c94-4843-871c-24b3b40bf3c2 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.166079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef79cf-59c1-4a9e-bdd6-16ec70ec6abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.166903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef79cf-59c1-4a9e-bdd6-16ec70ec6abf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.167184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef79cf-59c1-4a9e-bdd6-16ec70ec6abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.167450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef79cf-59c1-4a9e-bdd6-16ec70ec6abf admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.168105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef79cf-59c1-4a9e-bdd6-16ec70ec6abf admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.169679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef79cf-59c1-4a9e-bdd6-16ec70ec6abf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.183246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb429-c494-48c7-9fa9-4db808210b04 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.183531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb429-c494-48c7-9fa9-4db808210b04 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.183812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb429-c494-48c7-9fa9-4db808210b04 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.184424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-d6ef79cf-59c1-4a9e-bdd6-16ec70ec6abf admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 31 04:26:46.185742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 502/1006] 10.222.0.21 () {56 vars in 1147 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:46.185846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 505/1007] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:46.191085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e85d7-336e-4dfe-8c4b-70353285c902 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.191311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb429-c494-48c7-9fa9-4db808210b04 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.191426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e85d7-336e-4dfe-8c4b-70353285c902 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.191636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e85d7-336e-4dfe-8c4b-70353285c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.204304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb429-c494-48c7-9fa9-4db808210b04 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.208737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.209400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.209643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.209937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.210264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f24e85d7-336e-4dfe-8c4b-70353285c902 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:46.211283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:46.211836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.212129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f24e85d7-336e-4dfe-8c4b-70353285c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:46.213554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.218730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 506/1008] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:46.223394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 503/1009] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:46 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:46.224217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.233649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f631ff-d897-4c52-9cf3-d7c148b9ceeb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.238019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.238641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.238971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.239245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.239946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:46.240245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.242266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.243163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e85d7-336e-4dfe-8c4b-70353285c902 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.247639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 507/1010] 10.222.0.21 () {56 vars in 1143 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:46.252883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.255441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e85d7-336e-4dfe-8c4b-70353285c902 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.261015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.261728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.262002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.262268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] PATH_INFO: `/v3/services/image` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.262964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe672537-8ebb-4b82-87ea-1fa59e14b057 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.263079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.264594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.267379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.268090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.268273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.268544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.269273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.270837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.276643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 31 04:26:46.277757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 504/1011] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:46.283748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.293600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c17d2d-f3f6-4883-a218-fade0b6390fd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.298020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57457a-4dc9-40f4-be60-847b5cda0dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.298656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57457a-4dc9-40f4-be60-847b5cda0dff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.298964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57457a-4dc9-40f4-be60-847b5cda0dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.299239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57457a-4dc9-40f4-be60-847b5cda0dff admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.299943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57457a-4dc9-40f4-be60-847b5cda0dff admin admin] RBAC: Adding query filter params (name=image) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:46.300251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57457a-4dc9-40f4-be60-847b5cda0dff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.301801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57457a-4dc9-40f4-be60-847b5cda0dff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.307069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 505/1012] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:46.308206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a9ed8-bd6d-49e7-9d9a-be79945a6f5c None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.308489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a9ed8-bd6d-49e7-9d9a-be79945a6f5c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.308761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a9ed8-bd6d-49e7-9d9a-be79945a6f5c None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.310492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 506/1013] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:46.312449 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a9ed8-bd6d-49e7-9d9a-be79945a6f5c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.324474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a9ed8-bd6d-49e7-9d9a-be79945a6f5c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.328785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1c1ca-c891-4f1d-87ea-223764e7b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.329365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1c1ca-c891-4f1d-87ea-223764e7b685 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.329639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1c1ca-c891-4f1d-87ea-223764e7b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.329909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1c1ca-c891-4f1d-87ea-223764e7b685 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.330593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1c1ca-c891-4f1d-87ea-223764e7b685 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:46.330924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1c1ca-c891-4f1d-87ea-223764e7b685 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.332445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1c1ca-c891-4f1d-87ea-223764e7b685 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.337729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 507/1014] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:46.338764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4367642-4a59-4a20-a087-3283faf2e075 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.339078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4367642-4a59-4a20-a087-3283faf2e075 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.339352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4367642-4a59-4a20-a087-3283faf2e075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.357004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 508/1015] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:26:46.357004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.359086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c4367642-4a59-4a20-a087-3283faf2e075 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:46.359262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c4367642-4a59-4a20-a087-3283faf2e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:46.378323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 508/1016] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:46 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:46.379007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d92a4-2596-4d4a-8523-fe54b164d6a5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.384565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.385241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.385523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.385799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.386614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] RBAC: Adding query filter params (interface=public, service_id=74928cd61de74b5989d7de2a3261ff3e, region_id=RegionOne) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:46.386961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.388609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.394590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 509/1017] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/endpoints?service_id=74928cd61de74b5989d7de2a3261ff3e&interface=public®ion_id=RegionOne => generated 194 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:46.400764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4367642-4a59-4a20-a087-3283faf2e075 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.402897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.410823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4367642-4a59-4a20-a087-3283faf2e075 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.412816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da41b7-2c94-47cc-be7d-0da942b43e06 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.416151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.416823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.417129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.417370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.417728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.418063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.418521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.419026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.419306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.419741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.419968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.421559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.427010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 509/1018] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:26:46.434192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 31 04:26:46.436832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 510/1019] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:46.442231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.453686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06f0f5-bbb8-42f9-baea-221ae1ef33ff admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.458580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.459330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.459781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.459885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.460605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:46.460911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.462577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.473344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 510/1020] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:46.474245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.484801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfb623-eaad-4ecd-b81c-41b6b50c7543 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.489674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610b741-21f0-48bb-bc44-621600a8e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.490358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b741-21f0-48bb-bc44-621600a8e451 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.490642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b741-21f0-48bb-bc44-621600a8e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.490958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610b741-21f0-48bb-bc44-621600a8e451 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.492325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b741-21f0-48bb-bc44-621600a8e451 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:46.492834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b741-21f0-48bb-bc44-621600a8e451 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.494504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610b741-21f0-48bb-bc44-621600a8e451 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.500338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 511/1021] 10.222.0.21 () {56 vars in 1133 bytes} [Mon Jan 31 04:26:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:46.506554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:46.517397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0437056-3771-44c3-8640-43c364b5c7e8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:46.522381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533123c-a4b4-4643-8fac-3fd5b62dfb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:46.523839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533123c-a4b4-4643-8fac-3fd5b62dfb0f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:46.524189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533123c-a4b4-4643-8fac-3fd5b62dfb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:46.524580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533123c-a4b4-4643-8fac-3fd5b62dfb0f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:46.525244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533123c-a4b4-4643-8fac-3fd5b62dfb0f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:46.526911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533123c-a4b4-4643-8fac-3fd5b62dfb0f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:46.601095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 511/1022] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:48.607394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07904ff-6d91-4161-a078-ec893082e818 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.608423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07904ff-6d91-4161-a078-ec893082e818 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.608904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07904ff-6d91-4161-a078-ec893082e818 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.611184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 512/1023] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:48.616047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3cbd-6786-4727-a12d-038b5b60d229 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.616872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3cbd-6786-4727-a12d-038b5b60d229 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.617545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3cbd-6786-4727-a12d-038b5b60d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.636509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f04c3cbd-6786-4727-a12d-038b5b60d229 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:48.638002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f04c3cbd-6786-4727-a12d-038b5b60d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:48.656542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 512/1024] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:48 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:48.670894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767d4a-fee4-485f-ab4f-0fa13069e844 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.671180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767d4a-fee4-485f-ab4f-0fa13069e844 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.671594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62767d4a-fee4-485f-ab4f-0fa13069e844 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.673503 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 513/1025] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:48.680492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57121-7aea-4d4b-a970-357fdd8edeff None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.680888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57121-7aea-4d4b-a970-357fdd8edeff None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.681169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57121-7aea-4d4b-a970-357fdd8edeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.681800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767d4a-fee4-485f-ab4f-0fa13069e844 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:48.696398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62767d4a-fee4-485f-ab4f-0fa13069e844 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:48.699232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-fee57121-7aea-4d4b-a970-357fdd8edeff None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:48.700421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fee57121-7aea-4d4b-a970-357fdd8edeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:48.700869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:48.701636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.701912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.702179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.703350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:48.705002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:48.706718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 514/1026] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:48.708554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 513/1027] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:48 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:48.712651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:48.721821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6a88d-b018-4ef8-bfcd-3eb145629dfc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:48.726922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46081d1-dcdb-43f2-95d9-d6745a2bccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:48.727576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46081d1-dcdb-43f2-95d9-d6745a2bccab admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.727851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46081d1-dcdb-43f2-95d9-d6745a2bccab admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.728119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46081d1-dcdb-43f2-95d9-d6745a2bccab admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.728815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46081d1-dcdb-43f2-95d9-d6745a2bccab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:48.730661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46081d1-dcdb-43f2-95d9-d6745a2bccab admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:48.732752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee57121-7aea-4d4b-a970-357fdd8edeff None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:48.741700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee57121-7aea-4d4b-a970-357fdd8edeff None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:48.746302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:48.747102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.747432 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.747755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] PATH_INFO: `/v3/services/image` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.748373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:48.750034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:48.761368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 31 04:26:48.762536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 514/1028] 10.222.0.21 () {56 vars in 1126 bytes} [Mon Jan 31 04:26:48 2022] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:48.768345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:48.778367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e0bd0-e64f-4955-9b1a-d263f450a8cf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:48.783158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:48.783774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.784052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.784350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.785054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] RBAC: Adding query filter params (name=image) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:48.785367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:48.786949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:48.792501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 515/1029] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:48.797989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:48.807032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5455724-ae93-49b2-a3b8-5e196ecb044a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:48.811513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:48.812117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.812395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.812667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.813544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:48.813846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:48.815534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:48.820147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 516/1030] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:48.825751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:48.834903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe087f-3bd2-47fc-a90e-2a1e8bb13f3c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:48.840103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:48.840785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.841104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.841392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.842393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:48.844537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:48.856266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 515/1031] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:26:48 2022] POST /identity/v3/projects => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:26:48.915014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74806-5c63-41da-9ce6-337b261f94f1 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.915226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74806-5c63-41da-9ce6-337b261f94f1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.915450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74806-5c63-41da-9ce6-337b261f94f1 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.922836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 516/1032] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:26:48.923088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 517/1033] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:26:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:26:48.928071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10790bb3-b466-4cba-89d8-65dddf003871 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:48.928419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10790bb3-b466-4cba-89d8-65dddf003871 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:48.928630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10790bb3-b466-4cba-89d8-65dddf003871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:48.948562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-10790bb3-b466-4cba-89d8-65dddf003871 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:48.949879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-10790bb3-b466-4cba-89d8-65dddf003871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:49.028051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 517/1034] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:49.052879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.064566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604185fd-0667-490b-bee0-8856c5032bbf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.070930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.071908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.072294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.072659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.087898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:49.095295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 31 04:26:49.096525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 518/1035] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:49.103203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10790bb3-b466-4cba-89d8-65dddf003871 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.112627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10790bb3-b466-4cba-89d8-65dddf003871 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.117855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.118654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.119011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.119284 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.120075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:49.120376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.121958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.130692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 518/1036] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:49.137398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.147416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40086031-f84f-4a55-9ab3-cc7eaeb0bad7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.152385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.153160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.153435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.153703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.164901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.166780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.184347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:49.185729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 519/1037] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:49.191154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.201287 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdb8a-f471-4aaa-97e6-4d24ba9d24af admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.205899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.206548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.206851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.207128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.207859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:49.208209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.209847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.226851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 519/1038] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:49.229011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.238752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7af77d-dede-4979-93da-f4bf08da6b61 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.244085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.244981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.245332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.245721 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.253261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.255319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.269114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:49.270448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 520/1039] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:49.276448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.286368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83690d71-396f-4076-8628-c42f1f6202ef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.291680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.292338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.292619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.292894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.293746 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:49.294052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.295907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.314992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 520/1040] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:49.320678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.330169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a37e7b-ac00-40ba-b5c1-e9866f77f8f6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.334607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.335266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.335577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.335850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.343780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.345521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.355104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 521/1041] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:49.360825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.370565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b222-9fd3-4ce8-8f7d-201e2f96ff09 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.375144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.375908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.376188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.376459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.386881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.388703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.404805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:49.406340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 521/1042] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:49.411778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.420602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a7982-5851-48c3-8a32-d6414151b49a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.425070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.425694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.425975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.426249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.427010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:49.427316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.428894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.440835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 522/1043] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:49.446754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.456169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c4b53-2633-4062-9867-c63ac9f807d2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.460704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.461546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.461831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.462104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.468838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.470757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.483556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:49.484818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 522/1044] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:49.490235 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.500217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749da8c8-4dcd-467b-98dd-957b7228a836 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.504687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3ad7-1269-4433-9823-12a4dff68197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.505316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3ad7-1269-4433-9823-12a4dff68197 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.505604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3ad7-1269-4433-9823-12a4dff68197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.505876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3ad7-1269-4433-9823-12a4dff68197 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.506659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c3ad7-1269-4433-9823-12a4dff68197 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:49.506996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c3ad7-1269-4433-9823-12a4dff68197 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.509502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c3ad7-1269-4433-9823-12a4dff68197 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.522369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 523/1045] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:49.528068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:49.538429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d134-2066-4f75-9d91-2222a304c91c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:49.542940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99889667-77ea-400c-9f91-1e3ba98bd0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:49.549422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889667-77ea-400c-9f91-1e3ba98bd0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:49.549422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889667-77ea-400c-9f91-1e3ba98bd0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:49.549422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99889667-77ea-400c-9f91-1e3ba98bd0b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:49.549422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99889667-77ea-400c-9f91-1e3ba98bd0b7 admin admin] RBAC: Adding query filter params (role.id=010bf58c112e401993fcc162d4eb9125, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=bf69b08068054c4180f2d44c9c07cb60) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:49.549422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99889667-77ea-400c-9f91-1e3ba98bd0b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:49.549826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99889667-77ea-400c-9f91-1e3ba98bd0b7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:49.552968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 523/1046] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:49 2022] GET /identity/v3/role_assignments?user.id=bf69b08068054c4180f2d44c9c07cb60&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=010bf58c112e401993fcc162d4eb9125 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:51.169505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b796-39bb-46d9-a766-0dba8ca1b877 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.170054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b796-39bb-46d9-a766-0dba8ca1b877 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.170054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4b796-39bb-46d9-a766-0dba8ca1b877 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.171876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 524/1047] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:51.176981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6dad-066f-4efb-a201-435e77eda4e6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.177402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6dad-066f-4efb-a201-435e77eda4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.177544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b6dad-066f-4efb-a201-435e77eda4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.193868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef7f1-e28c-4960-acf9-1459812a078e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.194473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef7f1-e28c-4960-acf9-1459812a078e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.195600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadef7f1-e28c-4960-acf9-1459812a078e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.196482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-255b6dad-066f-4efb-a201-435e77eda4e6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:51.197600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 525/1048] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:51.197726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-255b6dad-066f-4efb-a201-435e77eda4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:51.202617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a695-558b-421c-9f20-7f3a732e3119 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.202931 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a695-558b-421c-9f20-7f3a732e3119 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.203206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a695-558b-421c-9f20-7f3a732e3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.205595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 524/1049] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:51.220503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-98f5a695-558b-421c-9f20-7f3a732e3119 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:51.221683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-98f5a695-558b-421c-9f20-7f3a732e3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:51.227600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b6dad-066f-4efb-a201-435e77eda4e6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.230283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 526/1050] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:26:51.236473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b6dad-066f-4efb-a201-435e77eda4e6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.240892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.242036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.242670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.242965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.250740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:51.252579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:51.255046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a695-558b-421c-9f20-7f3a732e3119 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.262855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 525/1051] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:26:51.265789 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a695-558b-421c-9f20-7f3a732e3119 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.268605 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.270649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.271459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.271737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.272005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.273529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:51.275368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:51.281737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 527/1052] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:51.281853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e37a1-c8cc-4eff-9b18-f1e4d2b85501 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.282572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.282672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4d8ba-154c-42e6-94f1-d9258d86bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.283383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d8ba-154c-42e6-94f1-d9258d86bb34 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.283664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d8ba-154c-42e6-94f1-d9258d86bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.283939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d8ba-154c-42e6-94f1-d9258d86bb34 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.285144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4d8ba-154c-42e6-94f1-d9258d86bb34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:51.286860 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4d8ba-154c-42e6-94f1-d9258d86bb34 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:51.290674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 526/1053] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:51.292761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8d96-bf7d-42b0-ba69-af6bd16ac009 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.297478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2715bcb-18fb-4979-9d80-38ad8681e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.298170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2715bcb-18fb-4979-9d80-38ad8681e0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.298447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2715bcb-18fb-4979-9d80-38ad8681e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.298718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2715bcb-18fb-4979-9d80-38ad8681e0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.299496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2715bcb-18fb-4979-9d80-38ad8681e0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:51.301467 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2715bcb-18fb-4979-9d80-38ad8681e0c5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:51.429638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 528/1054] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:26:51 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:26:51.796438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4518-bd01-4bee-b7d4-27c910e301c4 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.796718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4518-bd01-4bee-b7d4-27c910e301c4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.796990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b4518-bd01-4bee-b7d4-27c910e301c4 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.798752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 527/1055] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:51.804537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56a1b-81f5-4449-b8c0-3b7f72b44342 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.804839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56a1b-81f5-4449-b8c0-3b7f72b44342 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.805116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf56a1b-81f5-4449-b8c0-3b7f72b44342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.823125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-dcf56a1b-81f5-4449-b8c0-3b7f72b44342 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:51.824317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dcf56a1b-81f5-4449-b8c0-3b7f72b44342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:51.832008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 529/1056] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:51.855688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b4518-bd01-4bee-b7d4-27c910e301c4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.868359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b4518-bd01-4bee-b7d4-27c910e301c4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.872728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.873512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.873792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.874064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.884537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:51.891792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 31 04:26:51.893084 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 528/1057] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Jan 31 04:26:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:51.899174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf56a1b-81f5-4449-b8c0-3b7f72b44342 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.908269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf56a1b-81f5-4449-b8c0-3b7f72b44342 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.912693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.913337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.913839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.914118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.914901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:51.915210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:51.916828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:51.924609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 530/1058] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Jan 31 04:26:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:51.930585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.940429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c9278-7db8-4e17-99c8-254d7a5e74ee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.945564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.946883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.947380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.947880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.958300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:51.960143 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:51.976803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:51.977960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 529/1059] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:51.983652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:51.993566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58b6f8-01fd-4e19-a961-7554429a13cc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:51.997931 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:51.998560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:51.998857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:51.999128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:51.999840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:52.000136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.001693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.013782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 531/1060] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:52.019038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:52.028482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbca6f3-659b-4bca-9d8b-e556fafd38b3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:52.033232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:52.033983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:52.034264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:52.034534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:52.042382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.044463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.058505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:52.059591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 530/1061] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:52.064994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:52.074502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6a64-b9b6-402b-a7fd-a1f6ae31dc48 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:52.078912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:52.079550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:52.079882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:52.080157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:52.080989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:52.081286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.083160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.100413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 532/1062] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:52.106382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:52.115913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f50121-7435-4013-8eb5-c58f18cd8e41 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:52.121276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:52.122046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:52.122327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:52.122603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:52.133042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.134902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.151437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:52.152594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 531/1063] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:52.158410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:52.168757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01eea4-0c7f-48f5-8bfb-ab0f26423fab admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:52.173249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:52.173890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:52.174171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:52.174445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:52.175210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:52.175511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.177096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.189105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 533/1064] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:52.195472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:52.205053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dc35a-79ee-4f3c-a6dd-7a70bd0299c1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:52.209405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:52.210164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:52.210483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:52.210750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:52.217401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.219351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.232217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:52.233349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 532/1065] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:52.239195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:52.248919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416aad84-a5de-4cc9-8d10-6998ad93f9c3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:52.253563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952c095-7016-448d-bfad-7425afecab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:52.254270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c095-7016-448d-bfad-7425afecab40 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:52.254622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c095-7016-448d-bfad-7425afecab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:52.255005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c095-7016-448d-bfad-7425afecab40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:52.255864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952c095-7016-448d-bfad-7425afecab40 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:52.256238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952c095-7016-448d-bfad-7425afecab40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.258861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952c095-7016-448d-bfad-7425afecab40 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.270914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 534/1066] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:52.277543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:52.287905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097059c-98a3-499e-b4fc-bcbf31883d3b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:52.292313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9790f-d835-4fd9-9db9-b443a4a62765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:52.293162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9790f-d835-4fd9-9db9-b443a4a62765 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:52.293436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9790f-d835-4fd9-9db9-b443a4a62765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:52.293702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9790f-d835-4fd9-9db9-b443a4a62765 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/bf69b08068054c4180f2d44c9c07cb60/roles/010bf58c112e401993fcc162d4eb9125` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:52.295875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9790f-d835-4fd9-9db9-b443a4a62765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=bf69b08068054c4180f2d44c9c07cb60, role_id=010bf58c112e401993fcc162d4eb9125)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:52.298521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9790f-d835-4fd9-9db9-b443a4a62765 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:52.383004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 533/1067] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:52 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/bf69b08068054c4180f2d44c9c07cb60/roles/010bf58c112e401993fcc162d4eb9125 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:53.698923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4303f63-7ca3-4ca7-a810-56661db6ddbf None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:53.699451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4303f63-7ca3-4ca7-a810-56661db6ddbf None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:53.699451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4303f63-7ca3-4ca7-a810-56661db6ddbf None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:53.701185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 535/1068] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:53.706415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79532-4f78-4020-a18d-fdf3cf6db34d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:53.706834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79532-4f78-4020-a18d-fdf3cf6db34d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:53.706979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79532-4f78-4020-a18d-fdf3cf6db34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:53.724845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2da79532-4f78-4020-a18d-fdf3cf6db34d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:53.726623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2da79532-4f78-4020-a18d-fdf3cf6db34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:53.780045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 534/1069] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:53.804664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4303f63-7ca3-4ca7-a810-56661db6ddbf None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:53.816646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4303f63-7ca3-4ca7-a810-56661db6ddbf None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:53.821111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:53.821897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:53.822178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:53.822453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:53.832451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:53.839482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:53.840625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 536/1070] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:53.846444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79532-4f78-4020-a18d-fdf3cf6db34d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:53.855831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79532-4f78-4020-a18d-fdf3cf6db34d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:53.860256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:53.860889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:53.861164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:53.861431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:53.862179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:53.862475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:53.864083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:53.872591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 535/1071] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:53.877888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:53.888125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407489a-bac9-4127-a12a-2ee51fa0d549 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:53.892642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:53.893479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:53.893757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:53.894115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] PATH_INFO: `/v3/users/28180ced6eb64a2eb6294867f49d7803` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:53.907856 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] RBAC: Authorizing `identity:get_user(user_id=28180ced6eb64a2eb6294867f49d7803)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:53.909978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:53.911630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 537/1072] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:26:53 2022] GET /identity/v3/users/28180ced6eb64a2eb6294867f49d7803 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:53.918059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:53.927544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a984-9a36-44d8-87ea-08647ad1d1dc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:53.932151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:53.932837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:53.933182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:53.933538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:53.941300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:53.943070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:53.952138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 536/1073] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:53.957808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:53.989579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930db276-e40d-422b-8c6e-4a10e99e77ba admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:53.989579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dd4c0-88f2-4fcd-9c1f-411b125f88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:53.989579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dd4c0-88f2-4fcd-9c1f-411b125f88ad admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:53.989579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dd4c0-88f2-4fcd-9c1f-411b125f88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:53.990442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dd4c0-88f2-4fcd-9c1f-411b125f88ad admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:53.990442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dd4c0-88f2-4fcd-9c1f-411b125f88ad admin admin] RBAC: Authorizing `identity:get_project(project_id=c6ed73b8a4e34279a8f8546973e00ab6)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:53.990442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dd4c0-88f2-4fcd-9c1f-411b125f88ad admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:53.990442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 538/1074] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:26:53 2022] GET /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:53.990750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:53.997049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752931-af4c-4048-b216-fc3a45ca40d1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.001728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7f43f-011d-44b3-b441-056e7ee0dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.002438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7f43f-011d-44b3-b441-056e7ee0dc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.002811 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7f43f-011d-44b3-b441-056e7ee0dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.003102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7f43f-011d-44b3-b441-056e7ee0dc73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.003935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7f43f-011d-44b3-b441-056e7ee0dc73 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6, user.id=28180ced6eb64a2eb6294867f49d7803) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:54.004243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7f43f-011d-44b3-b441-056e7ee0dc73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.006067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7f43f-011d-44b3-b441-056e7ee0dc73 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.012643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 537/1075] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:53 2022] GET /identity/v3/role_assignments?user.id=28180ced6eb64a2eb6294867f49d7803&scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:54.597707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e6340-c083-4b18-866c-c78708db7bfc None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.598017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e6340-c083-4b18-866c-c78708db7bfc None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.598320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e6340-c083-4b18-866c-c78708db7bfc None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.600099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 539/1076] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:54.606138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f340-71ad-42fd-a4bf-f1ee42fd859f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.606429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f340-71ad-42fd-a4bf-f1ee42fd859f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.606707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f340-71ad-42fd-a4bf-f1ee42fd859f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.624725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-aed1f340-71ad-42fd-a4bf-f1ee42fd859f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:54.625907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-aed1f340-71ad-42fd-a4bf-f1ee42fd859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:54.633676 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 538/1077] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:54.658528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e6340-c083-4b18-866c-c78708db7bfc None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.671252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e6340-c083-4b18-866c-c78708db7bfc None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.675570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.676354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.676633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.676908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.687041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:54.694286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 31 04:26:54.695633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 540/1078] 10.222.0.21 () {56 vars in 1141 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:54.701524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f340-71ad-42fd-a4bf-f1ee42fd859f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.710940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f340-71ad-42fd-a4bf-f1ee42fd859f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.715406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.716114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.716458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.716792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.717607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:54.717973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.719665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.728308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 539/1079] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:54.733906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.744277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a4d8-2751-4716-9e9d-41dfba41e1c4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.748765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.749512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.749785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.750047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.760032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.761835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.778320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:54.779587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 541/1080] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:54.785495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.796338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126c75-0b15-4a2b-8410-f92e9bb1d24f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.800859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.801493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.801773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.802043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.802764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:54.803095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.805038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.817128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 540/1081] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:54.822987 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.832548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44244832-2966-4e23-bb1e-bc6a48abc7b8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.837657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.838410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.838689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.838988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.846184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.848283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.862199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 31 04:26:54.863499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 542/1082] 10.222.0.21 () {56 vars in 1114 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:54.869093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.878598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd84194-103f-4f5a-9070-bbdc110881ba admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.883065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.883719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.883995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.884264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.885102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:54.885405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.887252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.904513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 541/1083] 10.222.0.21 () {56 vars in 1154 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:54.910409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.920683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c71e76-95fb-4d4b-9e51-71a08ae7abbc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.925113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.925730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.926006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.926276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.933803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.935584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.944290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 543/1084] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:54.949944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:54.959564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03c2c8-f2a0-4861-adc0-85d3e1e7ef53 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:54.964704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:54.965468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:54.965748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:54.966019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:54.976856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:54.978668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:54.995008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:26:54.996167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 542/1085] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:26:55.001733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:55.010427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95784f62-79d3-4ba7-909b-12f9aeb75410 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:55.014947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:55.015583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:55.015862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:55.016131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:55.016857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:55.017155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:55.018738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:55.030485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 544/1086] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:55.036457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:55.046610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029656-2f21-48af-bc89-1b05af757691 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:55.051107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:55.051873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:55.052157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:55.052433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:55.059130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:55.061063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:55.074469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:26:55.075643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 543/1087] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:55.081511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:55.091999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32d31e-dd98-4f4e-936a-95018e26a001 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:55.096556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9891ec-a187-4d34-a3c5-a1e7e9af852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:55.097192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9891ec-a187-4d34-a3c5-a1e7e9af852b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:55.097468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9891ec-a187-4d34-a3c5-a1e7e9af852b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:55.097738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9891ec-a187-4d34-a3c5-a1e7e9af852b admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:55.098571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9891ec-a187-4d34-a3c5-a1e7e9af852b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:55.098850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9891ec-a187-4d34-a3c5-a1e7e9af852b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:55.100760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9891ec-a187-4d34-a3c5-a1e7e9af852b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:55.113720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 545/1088] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:55.120410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:55.130747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c86f6-b7b3-4c0f-9654-d0e795f5bab2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:55.135785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42369d-dab3-4c65-988b-d5537f78db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:55.136406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42369d-dab3-4c65-988b-d5537f78db18 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:55.136683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42369d-dab3-4c65-988b-d5537f78db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:55.136950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42369d-dab3-4c65-988b-d5537f78db18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:55.137771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42369d-dab3-4c65-988b-d5537f78db18 admin admin] RBAC: Adding query filter params (role.id=010bf58c112e401993fcc162d4eb9125, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=bf69b08068054c4180f2d44c9c07cb60) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:55.138071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42369d-dab3-4c65-988b-d5537f78db18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:55.139911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42369d-dab3-4c65-988b-d5537f78db18 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:55.145734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 544/1089] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:55 2022] GET /identity/v3/role_assignments?user.id=bf69b08068054c4180f2d44c9c07cb60&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=010bf58c112e401993fcc162d4eb9125 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:56.202703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68f9c-f71a-4e8e-96d5-60a27f49d9fc None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:56.203239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68f9c-f71a-4e8e-96d5-60a27f49d9fc None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:56.203354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68f9c-f71a-4e8e-96d5-60a27f49d9fc None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:56.205006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 546/1090] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:56.210628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bdfd7-37b9-4a68-b9f7-bf2b75483095 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:56.211086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bdfd7-37b9-4a68-b9f7-bf2b75483095 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:56.211211 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bdfd7-37b9-4a68-b9f7-bf2b75483095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:56.229299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-937bdfd7-37b9-4a68-b9f7-bf2b75483095 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:56.230473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-937bdfd7-37b9-4a68-b9f7-bf2b75483095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:56.238020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 545/1091] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:56.261063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68f9c-f71a-4e8e-96d5-60a27f49d9fc None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:56.273395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68f9c-f71a-4e8e-96d5-60a27f49d9fc None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:56.277656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:56.278402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:56.278676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:56.278986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:56.289778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:56.296362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:56.297463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 547/1092] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:56.303082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bdfd7-37b9-4a68-b9f7-bf2b75483095 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:56.311859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bdfd7-37b9-4a68-b9f7-bf2b75483095 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:56.316336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:56.316971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:56.317260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:56.317535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:56.318290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:56.318594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:56.320393 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:56.328400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 546/1093] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:56.333779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:56.343996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5fe3d-2b5b-4447-a4fb-ed09b5bea473 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:56.348331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:56.349131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:56.349402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:56.349670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] PATH_INFO: `/v3/users/28180ced6eb64a2eb6294867f49d7803` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:56.351741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] RBAC: Authorizing `identity:get_user(user_id=28180ced6eb64a2eb6294867f49d7803)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:56.353834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:56.355373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 548/1094] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:26:56 2022] GET /identity/v3/users/28180ced6eb64a2eb6294867f49d7803 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:26:56.360530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:56.369911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254da90-4115-4dfb-8a15-e60de1d64b47 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:56.374336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cfced-7ca4-43be-bc30-09643c77672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:56.375183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cfced-7ca4-43be-bc30-09643c77672f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:56.375465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cfced-7ca4-43be-bc30-09643c77672f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:56.375758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cfced-7ca4-43be-bc30-09643c77672f admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:56.376933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cfced-7ca4-43be-bc30-09643c77672f admin admin] RBAC: Authorizing `identity:get_project(project_id=c6ed73b8a4e34279a8f8546973e00ab6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:56.379004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cfced-7ca4-43be-bc30-09643c77672f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:56.380600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 547/1095] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:26:56 2022] GET /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:56.385714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:56.394678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113019-f01f-49e3-8724-56157e8d085d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:56.399723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1424ac1-46b2-4f89-835f-768e04b8c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:56.400534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424ac1-46b2-4f89-835f-768e04b8c36d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:56.400806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424ac1-46b2-4f89-835f-768e04b8c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:56.401070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1424ac1-46b2-4f89-835f-768e04b8c36d admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6/users/28180ced6eb64a2eb6294867f49d7803/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:56.403004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424ac1-46b2-4f89-835f-768e04b8c36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ed73b8a4e34279a8f8546973e00ab6, user_id=28180ced6eb64a2eb6294867f49d7803, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:56.405605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1424ac1-46b2-4f89-835f-768e04b8c36d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:56.472680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 549/1096] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:26:56 2022] PUT /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6/users/28180ced6eb64a2eb6294867f49d7803/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:26:58.661778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40a5c1-dae6-465f-8a82-d91a076b67b6 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.662310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40a5c1-dae6-465f-8a82-d91a076b67b6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.662310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40a5c1-dae6-465f-8a82-d91a076b67b6 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.664703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 548/1097] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:26:58.670139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb81d0-0bed-44be-a0af-02d1001eac83 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.670594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb81d0-0bed-44be-a0af-02d1001eac83 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.670681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb81d0-0bed-44be-a0af-02d1001eac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.689664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f5fb81d0-0bed-44be-a0af-02d1001eac83 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:26:58.690893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f5fb81d0-0bed-44be-a0af-02d1001eac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:26:58.754088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 550/1098] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:26:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:26:58.778485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40a5c1-dae6-465f-8a82-d91a076b67b6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:58.791692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40a5c1-dae6-465f-8a82-d91a076b67b6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:58.795958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:58.796723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.797003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.797275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.807205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:26:58.813865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:26:58.815042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 549/1099] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:26:58.821416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb81d0-0bed-44be-a0af-02d1001eac83 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:58.830160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb81d0-0bed-44be-a0af-02d1001eac83 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:58.834535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:58.835855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.836184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.836452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.837195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:58.837489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:58.839093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:58.847118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 551/1100] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:58.852806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:58.862852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3855-6cbf-4386-9146-de29b518f527 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:58.867379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:58.868202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.868476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.868743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] PATH_INFO: `/v3/users/28180ced6eb64a2eb6294867f49d7803` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.869930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] RBAC: Authorizing `identity:get_user(user_id=28180ced6eb64a2eb6294867f49d7803)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:58.872061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:58.873645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 550/1101] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:26:58 2022] GET /identity/v3/users/28180ced6eb64a2eb6294867f49d7803 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:58.879041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:58.889323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06b5f-bbfe-474a-a799-9977a3ae3576 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:58.893770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:58.894382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.894690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.894959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.903185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:58.904917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:58.913952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 552/1102] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:26:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:26:58.921534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:58.931283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed60f4-0163-41a2-8fc1-54a452bc5552 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:58.936142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21786d-e9f1-4c09-b420-ae7190ed2315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:58.936977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21786d-e9f1-4c09-b420-ae7190ed2315 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.937253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21786d-e9f1-4c09-b420-ae7190ed2315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.937520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21786d-e9f1-4c09-b420-ae7190ed2315 admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.938681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21786d-e9f1-4c09-b420-ae7190ed2315 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6ed73b8a4e34279a8f8546973e00ab6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:58.940747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21786d-e9f1-4c09-b420-ae7190ed2315 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:58.942382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 551/1103] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:26:58 2022] GET /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:26:58.948796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:26:58.957644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857bad-b3c8-4cec-a653-92cfbd736431 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:26:58.962958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68ba21-d0b6-4045-aa75-fe66579d76e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:26:58.963605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68ba21-d0b6-4045-aa75-fe66579d76e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:26:58.963887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68ba21-d0b6-4045-aa75-fe66579d76e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:26:58.964173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68ba21-d0b6-4045-aa75-fe66579d76e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:26:58.965055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68ba21-d0b6-4045-aa75-fe66579d76e2 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6, user.id=28180ced6eb64a2eb6294867f49d7803) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:26:58.965393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68ba21-d0b6-4045-aa75-fe66579d76e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:26:58.967362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68ba21-d0b6-4045-aa75-fe66579d76e2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:26:58.973238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 553/1104] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:26:58 2022] GET /identity/v3/role_assignments?user.id=28180ced6eb64a2eb6294867f49d7803&scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:01.182157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df207-c015-4c37-a65e-f6ca9104ea14 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:01.182666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df207-c015-4c37-a65e-f6ca9104ea14 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:01.182779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df207-c015-4c37-a65e-f6ca9104ea14 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:01.184478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 552/1105] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:01.189637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272609fc-1eb0-4023-816e-17c1f3381a60 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:01.190054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272609fc-1eb0-4023-816e-17c1f3381a60 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:01.190195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272609fc-1eb0-4023-816e-17c1f3381a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:01.207643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-272609fc-1eb0-4023-816e-17c1f3381a60 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:01.208823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-272609fc-1eb0-4023-816e-17c1f3381a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:01.216609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 554/1106] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:01.242233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909df207-c015-4c37-a65e-f6ca9104ea14 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:01.254245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909df207-c015-4c37-a65e-f6ca9104ea14 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:01.258925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28971695-245c-4c23-b632-89ec48030893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:01.259679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28971695-245c-4c23-b632-89ec48030893 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:01.259957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28971695-245c-4c23-b632-89ec48030893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:01.260226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28971695-245c-4c23-b632-89ec48030893 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:01.261384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28971695-245c-4c23-b632-89ec48030893 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:01.263080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28971695-245c-4c23-b632-89ec48030893 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:01.264625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 553/1107] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:01.269934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272609fc-1eb0-4023-816e-17c1f3381a60 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:01.278888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272609fc-1eb0-4023-816e-17c1f3381a60 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:01.283574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575649f-d213-4044-88b3-be83d8d370b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:01.284211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575649f-d213-4044-88b3-be83d8d370b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:01.284491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575649f-d213-4044-88b3-be83d8d370b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:01.284766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575649f-d213-4044-88b3-be83d8d370b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:01.285471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575649f-d213-4044-88b3-be83d8d370b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:01.287412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575649f-d213-4044-88b3-be83d8d370b3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:01.395764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 555/1108] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:27:01 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:27:03.685724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d8ee-076e-48f9-bb6c-1ca91d45bad5 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:03.686254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d8ee-076e-48f9-bb6c-1ca91d45bad5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:03.686254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d8ee-076e-48f9-bb6c-1ca91d45bad5 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:03.688049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 554/1109] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:03.693505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85869e-3eab-414b-82e6-7bad2a4eed60 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:03.693932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85869e-3eab-414b-82e6-7bad2a4eed60 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:03.694049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85869e-3eab-414b-82e6-7bad2a4eed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:03.712250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9b85869e-3eab-414b-82e6-7bad2a4eed60 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:03.713405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9b85869e-3eab-414b-82e6-7bad2a4eed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:03.720873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 556/1110] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:27:03.744658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97d8ee-076e-48f9-bb6c-1ca91d45bad5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:03.756585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97d8ee-076e-48f9-bb6c-1ca91d45bad5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:03.761430 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:03.762246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:03.762525 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:03.762813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] PATH_INFO: `/v3/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:03.764276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] RBAC: Authorizing `identity:get_role(role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:03.765281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:27:03.765281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:27:03.765281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:27:03.766146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:03.767476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 555/1111] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:03 2022] GET /identity/v3/roles/8fce00171f5149e2b0de6dffe397598a => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:03.773141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85869e-3eab-414b-82e6-7bad2a4eed60 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:03.782010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85869e-3eab-414b-82e6-7bad2a4eed60 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:03.786438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:03.787315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:03.787585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:03.787850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] PATH_INFO: `/v3/users/2cab23a1498c4177845ce2f31a25d014` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:03.801288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] RBAC: Authorizing `identity:get_user(user_id=2cab23a1498c4177845ce2f31a25d014)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:03.803459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:03.805168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 557/1112] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:03 2022] GET /identity/v3/users/2cab23a1498c4177845ce2f31a25d014 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:03.810516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:03.820606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33124a8-9d8e-4f2a-80be-0f10b93a4d81 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:03.825041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:03.825643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:03.825923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:03.826196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:03.833655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:03.836358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:03.844891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 556/1113] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:27:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:27:03.850156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:03.859999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fec998-45af-409a-9f8b-f95880593b5b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:03.864373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df39139-e7c4-4e8e-822c-c9be06b9dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:03.865174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39139-e7c4-4e8e-822c-c9be06b9dca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:03.865450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39139-e7c4-4e8e-822c-c9be06b9dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:03.865720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df39139-e7c4-4e8e-822c-c9be06b9dca2 admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:03.867118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df39139-e7c4-4e8e-822c-c9be06b9dca2 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6ed73b8a4e34279a8f8546973e00ab6)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:03.869093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df39139-e7c4-4e8e-822c-c9be06b9dca2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:03.870668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 558/1114] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:03 2022] GET /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:03.876206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:03.884729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed805-f74a-4239-adbc-175edd7f6735 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:03.889090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ea830-6f1d-44b0-8036-f6ef6ad1ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:03.889688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea830-6f1d-44b0-8036-f6ef6ad1ec7e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:03.889963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea830-6f1d-44b0-8036-f6ef6ad1ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:03.890230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea830-6f1d-44b0-8036-f6ef6ad1ec7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:03.891082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ea830-6f1d-44b0-8036-f6ef6ad1ec7e admin admin] RBAC: Adding query filter params (role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6, user.id=2cab23a1498c4177845ce2f31a25d014) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:03.891384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ea830-6f1d-44b0-8036-f6ef6ad1ec7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:03.893189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ea830-6f1d-44b0-8036-f6ef6ad1ec7e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:03.898895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 557/1115] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:27:03 2022] GET /identity/v3/role_assignments?user.id=2cab23a1498c4177845ce2f31a25d014&scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6&role.id=8fce00171f5149e2b0de6dffe397598a => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:06.089843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a6117-89af-4260-8358-96e0e0caed60 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:06.090305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a6117-89af-4260-8358-96e0e0caed60 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:06.090396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a6117-89af-4260-8358-96e0e0caed60 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:06.092369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 559/1116] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:06.097533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9a34-9c3d-4e25-9887-822539905f83 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:06.097962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9a34-9c3d-4e25-9887-822539905f83 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:06.098066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9a34-9c3d-4e25-9887-822539905f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:06.116070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-be2a9a34-9c3d-4e25-9887-822539905f83 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:06.117392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-be2a9a34-9c3d-4e25-9887-822539905f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:06.124911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 558/1117] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:27:06.147895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a6117-89af-4260-8358-96e0e0caed60 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:06.160026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a6117-89af-4260-8358-96e0e0caed60 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:06.165048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:06.165871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:06.166151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:06.166424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] PATH_INFO: `/v3/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:06.167918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] RBAC: Authorizing `identity:get_role(role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:06.168932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:27:06.168932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:27:06.168932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:27:06.169808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:06.171123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 560/1118] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:06 2022] GET /identity/v3/roles/8fce00171f5149e2b0de6dffe397598a => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:06.176383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a9a34-9c3d-4e25-9887-822539905f83 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:06.185207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a9a34-9c3d-4e25-9887-822539905f83 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:06.189629 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:06.190462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:06.190739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:06.191046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] PATH_INFO: `/v3/users/2cab23a1498c4177845ce2f31a25d014` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:06.192259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] RBAC: Authorizing `identity:get_user(user_id=2cab23a1498c4177845ce2f31a25d014)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:06.194356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:06.195934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 559/1119] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:06 2022] GET /identity/v3/users/2cab23a1498c4177845ce2f31a25d014 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:06.201011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:06.210776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0cb23-6b94-4f66-803a-0381b2427193 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:06.215233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21d138-4279-41e3-afc7-9c138242cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:06.216021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d138-4279-41e3-afc7-9c138242cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:06.216297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d138-4279-41e3-afc7-9c138242cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:06.216566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d138-4279-41e3-afc7-9c138242cc73 admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:06.217700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21d138-4279-41e3-afc7-9c138242cc73 admin admin] RBAC: Authorizing `identity:get_project(project_id=c6ed73b8a4e34279a8f8546973e00ab6)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:06.219712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21d138-4279-41e3-afc7-9c138242cc73 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:06.221271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 561/1120] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:06 2022] GET /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:06.227308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:06.236439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86e9ea-9140-4852-ba37-ba4f52cf5706 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:06.240872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e978-70d8-4971-bb2c-322c2ca2763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:06.241697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e978-70d8-4971-bb2c-322c2ca2763a admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:06.241974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e978-70d8-4971-bb2c-322c2ca2763a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:06.242242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e978-70d8-4971-bb2c-322c2ca2763a admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6/users/2cab23a1498c4177845ce2f31a25d014/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:06.244419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e978-70d8-4971-bb2c-322c2ca2763a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ed73b8a4e34279a8f8546973e00ab6, user_id=2cab23a1498c4177845ce2f31a25d014, role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:06.247014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e978-70d8-4971-bb2c-322c2ca2763a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:06.332338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 560/1121] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:27:06 2022] PUT /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6/users/2cab23a1498c4177845ce2f31a25d014/roles/8fce00171f5149e2b0de6dffe397598a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:27:08.495057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be176-c228-4b4d-8c29-7f5872d21bd7 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:08.495572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be176-c228-4b4d-8c29-7f5872d21bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:08.495572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be176-c228-4b4d-8c29-7f5872d21bd7 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:08.497322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 562/1122] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:08.502456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8d19-fdf4-4d0d-a73b-581bf6f35f92 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:08.502891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8d19-fdf4-4d0d-a73b-581bf6f35f92 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:08.503046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8d19-fdf4-4d0d-a73b-581bf6f35f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:08.520905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ec1c8d19-fdf4-4d0d-a73b-581bf6f35f92 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:08.522195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ec1c8d19-fdf4-4d0d-a73b-581bf6f35f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:08.577128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 561/1123] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:08.601133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be176-c228-4b4d-8c29-7f5872d21bd7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:08.612867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615be176-c228-4b4d-8c29-7f5872d21bd7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:08.617873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:08.618684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:08.618994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:08.619264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] PATH_INFO: `/v3/roles/8fce00171f5149e2b0de6dffe397598a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:08.620698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] RBAC: Authorizing `identity:get_role(role_id=8fce00171f5149e2b0de6dffe397598a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:08.622259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:08.623559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 563/1124] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:08 2022] GET /identity/v3/roles/8fce00171f5149e2b0de6dffe397598a => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:27:08.629054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8d19-fdf4-4d0d-a73b-581bf6f35f92 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:08.637733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8d19-fdf4-4d0d-a73b-581bf6f35f92 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:08.642197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:08.643069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:08.643352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:08.643626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] PATH_INFO: `/v3/users/2cab23a1498c4177845ce2f31a25d014` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:08.644827 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] RBAC: Authorizing `identity:get_user(user_id=2cab23a1498c4177845ce2f31a25d014)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:08.646974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:08.648525 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 562/1125] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:08 2022] GET /identity/v3/users/2cab23a1498c4177845ce2f31a25d014 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:08.653595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:08.663663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754161ee-06b3-4cb7-803d-21876219e1e6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:08.667838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:08.668479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:08.668760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:08.669029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:08.676550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:08.678231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:08.687339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 564/1126] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:27:08 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:27:08.692710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:08.701959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150c39f-6d4f-451d-bf0a-3a355c78fd0c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:08.706424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90d155-56bc-462c-a0c4-e9a135a3f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:08.707255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d155-56bc-462c-a0c4-e9a135a3f92e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:08.707538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d155-56bc-462c-a0c4-e9a135a3f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:08.707814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90d155-56bc-462c-a0c4-e9a135a3f92e admin admin] PATH_INFO: `/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:08.708980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90d155-56bc-462c-a0c4-e9a135a3f92e admin admin] RBAC: Authorizing `identity:get_project(project_id=c6ed73b8a4e34279a8f8546973e00ab6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:08.711010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90d155-56bc-462c-a0c4-e9a135a3f92e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:08.712607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 563/1127] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:08 2022] GET /identity/v3/projects/c6ed73b8a4e34279a8f8546973e00ab6 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:08.717921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:08.726806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a0636-c428-44ed-8a96-6687f5fe57ae admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:08.731157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a20a7d-ae7d-473f-8cd5-e752c6562995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:08.731751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a20a7d-ae7d-473f-8cd5-e752c6562995 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:08.732028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a20a7d-ae7d-473f-8cd5-e752c6562995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:08.732298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a20a7d-ae7d-473f-8cd5-e752c6562995 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:08.733103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a20a7d-ae7d-473f-8cd5-e752c6562995 admin admin] RBAC: Adding query filter params (role.id=8fce00171f5149e2b0de6dffe397598a, scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6, user.id=2cab23a1498c4177845ce2f31a25d014) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:08.733403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a20a7d-ae7d-473f-8cd5-e752c6562995 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:08.735201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a20a7d-ae7d-473f-8cd5-e752c6562995 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:08.740720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 565/1128] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:27:08 2022] GET /identity/v3/role_assignments?user.id=2cab23a1498c4177845ce2f31a25d014&scope.project.id=c6ed73b8a4e34279a8f8546973e00ab6&role.id=8fce00171f5149e2b0de6dffe397598a => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:10.928917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077fbba-208c-4242-9600-c5cd0722e1c4 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:10.929450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077fbba-208c-4242-9600-c5cd0722e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:10.929450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077fbba-208c-4242-9600-c5cd0722e1c4 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:10.931266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 564/1129] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:10.936889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599caaa-065e-42a2-b310-a3a24faecf3a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:10.937265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599caaa-065e-42a2-b310-a3a24faecf3a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:10.937428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599caaa-065e-42a2-b310-a3a24faecf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:10.954502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a599caaa-065e-42a2-b310-a3a24faecf3a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:10.955696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a599caaa-065e-42a2-b310-a3a24faecf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:10.963168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 566/1130] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:10.986437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077fbba-208c-4242-9600-c5cd0722e1c4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:10.998915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077fbba-208c-4242-9600-c5cd0722e1c4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:11.003226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895a19d-8837-4083-84a8-a9b25efd9fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:11.003980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895a19d-8837-4083-84a8-a9b25efd9fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:11.004292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895a19d-8837-4083-84a8-a9b25efd9fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:11.004567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895a19d-8837-4083-84a8-a9b25efd9fc8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:11.005736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895a19d-8837-4083-84a8-a9b25efd9fc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:11.007447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895a19d-8837-4083-84a8-a9b25efd9fc8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:11.008989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 565/1131] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:27:11.014289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599caaa-065e-42a2-b310-a3a24faecf3a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:11.023268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599caaa-065e-42a2-b310-a3a24faecf3a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:11.027729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a5b8f-5eff-41b3-955f-8bbbb4d0aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:11.028353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a5b8f-5eff-41b3-955f-8bbbb4d0aeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:11.028630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a5b8f-5eff-41b3-955f-8bbbb4d0aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:11.028898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a5b8f-5eff-41b3-955f-8bbbb4d0aeb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:11.029609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a5b8f-5eff-41b3-955f-8bbbb4d0aeb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:11.031814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a5b8f-5eff-41b3-955f-8bbbb4d0aeb6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:11.145614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 567/1132] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:27:11 2022] POST /identity/v3/projects => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:27:13.366267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe747be-0e9d-4abc-9b85-a1b18715ca7c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:13.366771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe747be-0e9d-4abc-9b85-a1b18715ca7c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:13.366771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe747be-0e9d-4abc-9b85-a1b18715ca7c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:13.368538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 566/1133] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:13.373841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd602b-a088-449c-b290-64543bfca28d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:13.374254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd602b-a088-449c-b290-64543bfca28d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:13.374392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd602b-a088-449c-b290-64543bfca28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:13.392130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-cfcd602b-a088-449c-b290-64543bfca28d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:13.393300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-cfcd602b-a088-449c-b290-64543bfca28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:13.450244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 568/1134] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:13.474918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe747be-0e9d-4abc-9b85-a1b18715ca7c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:13.486551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe747be-0e9d-4abc-9b85-a1b18715ca7c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:13.491390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d541181-c568-42c3-be10-60d4e86ee870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:13.492136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541181-c568-42c3-be10-60d4e86ee870 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:13.492415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541181-c568-42c3-be10-60d4e86ee870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:13.492680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541181-c568-42c3-be10-60d4e86ee870 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:13.493835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d541181-c568-42c3-be10-60d4e86ee870 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:13.495524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d541181-c568-42c3-be10-60d4e86ee870 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:13.497050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 567/1135] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:27:13.502240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd602b-a088-449c-b290-64543bfca28d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:13.511550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd602b-a088-449c-b290-64543bfca28d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:13.515966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896d674-57ac-46bb-a83d-27ed1947a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:13.516601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896d674-57ac-46bb-a83d-27ed1947a626 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:13.516881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896d674-57ac-46bb-a83d-27ed1947a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:13.517155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896d674-57ac-46bb-a83d-27ed1947a626 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:13.517866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896d674-57ac-46bb-a83d-27ed1947a626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:13.519806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896d674-57ac-46bb-a83d-27ed1947a626 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:13.661851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 569/1136] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:27:13 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:27:15.885471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ed72b-f71c-411d-90f6-5be19f098b1f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:15.886043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ed72b-f71c-411d-90f6-5be19f098b1f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:15.886043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ed72b-f71c-411d-90f6-5be19f098b1f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:15.887825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 568/1137] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:15.892932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0e0a-b83e-4296-928b-26358e8cef60 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:15.893327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0e0a-b83e-4296-928b-26358e8cef60 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:15.893480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0e0a-b83e-4296-928b-26358e8cef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:15.911393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-999f0e0a-b83e-4296-928b-26358e8cef60 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:15.912724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-999f0e0a-b83e-4296-928b-26358e8cef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:15.920158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 570/1138] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:15.944236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ed72b-f71c-411d-90f6-5be19f098b1f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:15.956049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ed72b-f71c-411d-90f6-5be19f098b1f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:15.960388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:15.961145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:15.961425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:15.961699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:15.971546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:27:15.978498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:27:15.979649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 569/1139] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:27:15.985250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0e0a-b83e-4296-928b-26358e8cef60 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:15.994498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0e0a-b83e-4296-928b-26358e8cef60 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:15.999012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:15.999646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:15.999922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:16.000192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:16.000944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:16.001242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:16.002845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:16.011429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 571/1140] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:16.016735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:16.026764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f3792-c6fb-45c2-b619-9bdc86a7ff39 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:16.031491 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:16.032306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:16.032587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:16.032861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] PATH_INFO: `/v3/users/5409dbbe57d74edeaac4011d1f3c494a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:16.045932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] RBAC: Authorizing `identity:get_user(user_id=5409dbbe57d74edeaac4011d1f3c494a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:16.048085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:16.049655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 570/1141] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:16 2022] GET /identity/v3/users/5409dbbe57d74edeaac4011d1f3c494a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:16.055773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:16.064932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361eada-c0ae-41f1-94da-4a941139cff7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:16.069350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:16.069956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:16.070297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:16.070569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:16.078035 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:16.079793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:16.088635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 572/1142] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:27:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:27:16.094175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:16.103994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c2e52-98e5-4fab-9cde-bd92b89c4266 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:16.108381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0219a8-e4e7-4424-b594-1c14b046c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:16.109203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0219a8-e4e7-4424-b594-1c14b046c536 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:16.109478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0219a8-e4e7-4424-b594-1c14b046c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:16.109749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0219a8-e4e7-4424-b594-1c14b046c536 admin admin] PATH_INFO: `/v3/projects/f0daa49f0ce2463c972e0e005964eb15` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:16.110923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0219a8-e4e7-4424-b594-1c14b046c536 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0daa49f0ce2463c972e0e005964eb15)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:16.112925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0219a8-e4e7-4424-b594-1c14b046c536 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:16.114516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 571/1143] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:16 2022] GET /identity/v3/projects/f0daa49f0ce2463c972e0e005964eb15 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:16.120673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:16.129150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b48ea-6466-43ec-aef1-6c94ed6ebe1c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:16.133884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412f196-f585-4bd2-b7e8-2104da1303ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:16.134489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412f196-f585-4bd2-b7e8-2104da1303ef admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:16.134890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412f196-f585-4bd2-b7e8-2104da1303ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:16.135065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412f196-f585-4bd2-b7e8-2104da1303ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:16.135930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412f196-f585-4bd2-b7e8-2104da1303ef admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=f0daa49f0ce2463c972e0e005964eb15, user.id=5409dbbe57d74edeaac4011d1f3c494a) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:16.136191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412f196-f585-4bd2-b7e8-2104da1303ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:16.137985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412f196-f585-4bd2-b7e8-2104da1303ef admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:16.143183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 573/1144] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:27:16 2022] GET /identity/v3/role_assignments?user.id=5409dbbe57d74edeaac4011d1f3c494a&scope.project.id=f0daa49f0ce2463c972e0e005964eb15&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:18.317114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6aa06-372d-41b2-ae66-b2beadea9a6a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:18.317664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6aa06-372d-41b2-ae66-b2beadea9a6a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:18.317664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6aa06-372d-41b2-ae66-b2beadea9a6a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:18.319547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 572/1145] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:18.324655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b730c-e6df-4a5b-a738-da0b139939f9 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:18.325058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b730c-e6df-4a5b-a738-da0b139939f9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:18.325199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b730c-e6df-4a5b-a738-da0b139939f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:18.342350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d70b730c-e6df-4a5b-a738-da0b139939f9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:18.343484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d70b730c-e6df-4a5b-a738-da0b139939f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:18.351502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 574/1146] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:18.375040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6aa06-372d-41b2-ae66-b2beadea9a6a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:18.387101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6aa06-372d-41b2-ae66-b2beadea9a6a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:18.391401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:18.392182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:18.392464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:18.392741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:18.404115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:27:18.411092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:27:18.412723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 573/1147] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:27:18.418438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b730c-e6df-4a5b-a738-da0b139939f9 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:18.427174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b730c-e6df-4a5b-a738-da0b139939f9 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:18.432260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:18.432899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:18.433179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:18.433450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:18.434201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:18.434502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:18.436128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:18.444208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 575/1148] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:18.449538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:18.459386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af620ff3-8120-48ec-82aa-edffa4aa7a45 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:18.463748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:18.464551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:18.464825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:18.465092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] PATH_INFO: `/v3/users/5409dbbe57d74edeaac4011d1f3c494a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:18.466254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] RBAC: Authorizing `identity:get_user(user_id=5409dbbe57d74edeaac4011d1f3c494a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:18.468367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:18.469883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 574/1149] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:18 2022] GET /identity/v3/users/5409dbbe57d74edeaac4011d1f3c494a => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:18.475733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:18.484959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97830753-6b84-4bca-a72f-982c19c4ef26 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:18.489401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc72a1-331e-4a63-9e86-4edc089a21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:18.490202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc72a1-331e-4a63-9e86-4edc089a21a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:18.491300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc72a1-331e-4a63-9e86-4edc089a21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:18.491300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc72a1-331e-4a63-9e86-4edc089a21a5 admin admin] PATH_INFO: `/v3/projects/f0daa49f0ce2463c972e0e005964eb15` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:18.492691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc72a1-331e-4a63-9e86-4edc089a21a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0daa49f0ce2463c972e0e005964eb15)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:18.494806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc72a1-331e-4a63-9e86-4edc089a21a5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:18.496466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 576/1150] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:18 2022] GET /identity/v3/projects/f0daa49f0ce2463c972e0e005964eb15 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:18.501777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:18.511175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d4c46-b352-4386-98ff-fe5a7e00f312 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:18.515551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746ff91-1d70-4ff6-aed9-26fa565eb220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:18.516387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ff91-1d70-4ff6-aed9-26fa565eb220 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:18.516666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ff91-1d70-4ff6-aed9-26fa565eb220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:18.516936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ff91-1d70-4ff6-aed9-26fa565eb220 admin admin] PATH_INFO: `/v3/projects/f0daa49f0ce2463c972e0e005964eb15/users/5409dbbe57d74edeaac4011d1f3c494a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:18.518902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ff91-1d70-4ff6-aed9-26fa565eb220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0daa49f0ce2463c972e0e005964eb15, user_id=5409dbbe57d74edeaac4011d1f3c494a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:18.521486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ff91-1d70-4ff6-aed9-26fa565eb220 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:18.630216 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 575/1151] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:27:18 2022] PUT /identity/v3/projects/f0daa49f0ce2463c972e0e005964eb15/users/5409dbbe57d74edeaac4011d1f3c494a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:27:20.812191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ccd01-fdaa-47cb-8c63-88765fbf3577 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:20.812744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ccd01-fdaa-47cb-8c63-88765fbf3577 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:20.812744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ccd01-fdaa-47cb-8c63-88765fbf3577 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:20.814458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 577/1152] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:20.819820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89b63-f3c6-4d66-a484-25ca475a6533 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:20.820362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89b63-f3c6-4d66-a484-25ca475a6533 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:20.820533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89b63-f3c6-4d66-a484-25ca475a6533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:20.837616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-01f89b63-f3c6-4d66-a484-25ca475a6533 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:20.838811 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-01f89b63-f3c6-4d66-a484-25ca475a6533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:20.893713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 576/1153] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:20.919040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ccd01-fdaa-47cb-8c63-88765fbf3577 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:20.931038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ccd01-fdaa-47cb-8c63-88765fbf3577 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:20.935323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:20.936080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:20.936358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:20.936628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:20.946698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:27:20.953343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:27:20.954495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 578/1154] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:27:20.960081 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89b63-f3c6-4d66-a484-25ca475a6533 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:20.969354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89b63-f3c6-4d66-a484-25ca475a6533 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:20.973795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:20.974436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:20.974719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:20.975029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:20.975785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:20.976201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:20.978373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:20.986353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 577/1155] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:20.991764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:21.001951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e013e5c-8b6b-49c0-a5b9-7d75e1f02d1c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:21.006366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:21.007222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:21.007590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:21.007993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] PATH_INFO: `/v3/users/5409dbbe57d74edeaac4011d1f3c494a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:21.009282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] RBAC: Authorizing `identity:get_user(user_id=5409dbbe57d74edeaac4011d1f3c494a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:21.011416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:21.012937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 579/1156] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:20 2022] GET /identity/v3/users/5409dbbe57d74edeaac4011d1f3c494a => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:21.018050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:21.028067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c528574-690e-42a2-821d-f233a19d68fb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:21.032745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:21.033349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:21.033629 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:21.033902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:21.042310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:21.044061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:21.052565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 578/1157] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:27:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:27:21.057901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:21.067190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7ec2-53de-422d-9fb3-b30fc7e01309 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:21.071883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45dfd0-0f81-41db-97bd-05dad28f0cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:21.072674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45dfd0-0f81-41db-97bd-05dad28f0cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:21.072949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45dfd0-0f81-41db-97bd-05dad28f0cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:21.073218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45dfd0-0f81-41db-97bd-05dad28f0cc9 admin admin] PATH_INFO: `/v3/projects/f0daa49f0ce2463c972e0e005964eb15` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:21.074373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45dfd0-0f81-41db-97bd-05dad28f0cc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0daa49f0ce2463c972e0e005964eb15)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:21.076381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45dfd0-0f81-41db-97bd-05dad28f0cc9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:21.077940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 580/1158] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:21 2022] GET /identity/v3/projects/f0daa49f0ce2463c972e0e005964eb15 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:21.083430 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:21.092633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0907e-b907-4f4e-b030-a5e310610c78 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:21.097068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d65522-52ab-4f8a-a946-412687738535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:21.097678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65522-52ab-4f8a-a946-412687738535 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:21.097955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65522-52ab-4f8a-a946-412687738535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:21.098222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d65522-52ab-4f8a-a946-412687738535 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:21.099074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65522-52ab-4f8a-a946-412687738535 admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=f0daa49f0ce2463c972e0e005964eb15, user.id=5409dbbe57d74edeaac4011d1f3c494a) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:21.099381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65522-52ab-4f8a-a946-412687738535 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:21.101812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d65522-52ab-4f8a-a946-412687738535 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:21.107444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 579/1159] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:27:21 2022] GET /identity/v3/role_assignments?user.id=5409dbbe57d74edeaac4011d1f3c494a&scope.project.id=f0daa49f0ce2463c972e0e005964eb15&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:23.329062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ac41-5b39-4ee9-92bd-569bb01ae012 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:23.329607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ac41-5b39-4ee9-92bd-569bb01ae012 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:23.329607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ac41-5b39-4ee9-92bd-569bb01ae012 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:23.331386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 581/1160] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:23.337221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ed1b-7a94-4d1d-955a-5c88bbbd051c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:23.337623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ed1b-7a94-4d1d-955a-5c88bbbd051c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:23.337713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ed1b-7a94-4d1d-955a-5c88bbbd051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:23.355480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e237ed1b-7a94-4d1d-955a-5c88bbbd051c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:23.356654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e237ed1b-7a94-4d1d-955a-5c88bbbd051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:23.364234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 580/1161] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:27:23.387414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ac41-5b39-4ee9-92bd-569bb01ae012 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:23.400112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ac41-5b39-4ee9-92bd-569bb01ae012 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:23.404404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:23.405269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:23.405544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:23.405812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:23.413279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:23.416082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:23.424700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 582/1162] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:27:23 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:27:23.430836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ed1b-7a94-4d1d-955a-5c88bbbd051c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:23.439450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ed1b-7a94-4d1d-955a-5c88bbbd051c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:23.443862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173503b-b400-4e3f-9fdc-563cd59b44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:23.444624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173503b-b400-4e3f-9fdc-563cd59b44c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:23.445647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173503b-b400-4e3f-9fdc-563cd59b44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:23.445930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173503b-b400-4e3f-9fdc-563cd59b44c0 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:23.452633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173503b-b400-4e3f-9fdc-563cd59b44c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:23.454419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173503b-b400-4e3f-9fdc-563cd59b44c0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:23.467670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-1173503b-b400-4e3f-9fdc-563cd59b44c0 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 31 04:27:23.468764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 581/1163] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:27:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:27:23.474295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:23.483027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c578-ca29-407a-840c-c0edaf5b5b41 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:23.487444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eebc94-3687-4ead-8a6b-97575c72ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:23.488081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebc94-3687-4ead-8a6b-97575c72ea2c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:23.488360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebc94-3687-4ead-8a6b-97575c72ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:23.488630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebc94-3687-4ead-8a6b-97575c72ea2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:23.489338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebc94-3687-4ead-8a6b-97575c72ea2c admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:23.489635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebc94-3687-4ead-8a6b-97575c72ea2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:23.491322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebc94-3687-4ead-8a6b-97575c72ea2c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:23.498907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 583/1164] 10.222.0.21 () {56 vars in 1136 bytes} [Mon Jan 31 04:27:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:25.698625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75844-015a-4acf-bd45-39404e00abc8 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:25.699179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75844-015a-4acf-bd45-39404e00abc8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:25.699309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75844-015a-4acf-bd45-39404e00abc8 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:25.700954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 582/1165] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:25.706357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7eeb-c000-4285-a4f8-5b8a4e55fd2c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:25.706809 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7eeb-c000-4285-a4f8-5b8a4e55fd2c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:25.706937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7eeb-c000-4285-a4f8-5b8a4e55fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:25.724343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-632c7eeb-c000-4285-a4f8-5b8a4e55fd2c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:25.725514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-632c7eeb-c000-4285-a4f8-5b8a4e55fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:25.733385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 584/1166] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:25.756594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75844-015a-4acf-bd45-39404e00abc8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:25.769091 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75844-015a-4acf-bd45-39404e00abc8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:25.773367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca32d8-2ac9-4662-be75-70e3acd15c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:25.773983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca32d8-2ac9-4662-be75-70e3acd15c5f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:25.774258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca32d8-2ac9-4662-be75-70e3acd15c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:25.774526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca32d8-2ac9-4662-be75-70e3acd15c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:25.775299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca32d8-2ac9-4662-be75-70e3acd15c5f admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:25.776301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-73ca32d8-2ac9-4662-be75-70e3acd15c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:27:25.776301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:27:25.776301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:27:25.777167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca32d8-2ac9-4662-be75-70e3acd15c5f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:25.861869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 583/1167] 10.222.0.21 () {60 vars in 1159 bytes} [Mon Jan 31 04:27:25 2022] POST /identity/v3/domains => generated 267 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:27:28.082150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9293f1-c2ca-44bb-944a-dfdaa25b7b0f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:28.082666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9293f1-c2ca-44bb-944a-dfdaa25b7b0f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:28.082666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9293f1-c2ca-44bb-944a-dfdaa25b7b0f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:28.084474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 585/1168] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:28.090029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a42798-c4b5-4d1f-a5ee-b33b8b31c214 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:28.090476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a42798-c4b5-4d1f-a5ee-b33b8b31c214 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:28.090569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a42798-c4b5-4d1f-a5ee-b33b8b31c214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:28.108352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-22a42798-c4b5-4d1f-a5ee-b33b8b31c214 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:28.109525 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-22a42798-c4b5-4d1f-a5ee-b33b8b31c214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:28.164937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 584/1169] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:28.189476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9293f1-c2ca-44bb-944a-dfdaa25b7b0f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:28.201617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9293f1-c2ca-44bb-944a-dfdaa25b7b0f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:28.205876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e295e4-6c18-4a97-8a40-9e1afc7ad925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:28.206697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e295e4-6c18-4a97-8a40-9e1afc7ad925 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:28.207001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e295e4-6c18-4a97-8a40-9e1afc7ad925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:28.207272 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e295e4-6c18-4a97-8a40-9e1afc7ad925 admin admin] PATH_INFO: `/v3/domains/a334d2cef15049e08ec56f8bb91e96ca` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:28.218399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e295e4-6c18-4a97-8a40-9e1afc7ad925 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a334d2cef15049e08ec56f8bb91e96ca)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:28.220392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e295e4-6c18-4a97-8a40-9e1afc7ad925 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:28.221988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 586/1170] 10.222.0.21 () {56 vars in 1204 bytes} [Mon Jan 31 04:27:28 2022] GET /identity/v3/domains/a334d2cef15049e08ec56f8bb91e96ca => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:28.228661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a42798-c4b5-4d1f-a5ee-b33b8b31c214 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:28.237535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a42798-c4b5-4d1f-a5ee-b33b8b31c214 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:28.242748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a9ff-4048-4fb1-8c99-8d2434bb371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:28.243416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a9ff-4048-4fb1-8c99-8d2434bb371e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:28.243694 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a9ff-4048-4fb1-8c99-8d2434bb371e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:28.243964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a9ff-4048-4fb1-8c99-8d2434bb371e admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:28.244683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3a9ff-4048-4fb1-8c99-8d2434bb371e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:28.246601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3a9ff-4048-4fb1-8c99-8d2434bb371e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:28.368588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 585/1171] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:27:28 2022] POST /identity/v3/projects => generated 361 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:27:30.583509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238398-16c0-41c0-8b76-4504ae841054 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:30.584057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238398-16c0-41c0-8b76-4504ae841054 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:30.584057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238398-16c0-41c0-8b76-4504ae841054 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:30.586441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 587/1172] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:30.591587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f204-98bf-4260-a514-da3aad767081 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:30.591989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f204-98bf-4260-a514-da3aad767081 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:30.592176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f204-98bf-4260-a514-da3aad767081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:30.609253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fc69f204-98bf-4260-a514-da3aad767081 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:30.610412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fc69f204-98bf-4260-a514-da3aad767081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:30.664978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 586/1173] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:30.689663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238398-16c0-41c0-8b76-4504ae841054 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:30.702332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238398-16c0-41c0-8b76-4504ae841054 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:30.706618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4645999-3a35-41fb-a3a4-941582e18eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:30.707471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645999-3a35-41fb-a3a4-941582e18eed admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:30.707749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645999-3a35-41fb-a3a4-941582e18eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:30.708017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4645999-3a35-41fb-a3a4-941582e18eed admin admin] PATH_INFO: `/v3/domains/a334d2cef15049e08ec56f8bb91e96ca` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:30.709182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4645999-3a35-41fb-a3a4-941582e18eed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a334d2cef15049e08ec56f8bb91e96ca)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:30.711185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4645999-3a35-41fb-a3a4-941582e18eed admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:30.712750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 588/1174] 10.222.0.21 () {56 vars in 1204 bytes} [Mon Jan 31 04:27:30 2022] GET /identity/v3/domains/a334d2cef15049e08ec56f8bb91e96ca => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:30.718011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f204-98bf-4260-a514-da3aad767081 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:30.726993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f204-98bf-4260-a514-da3aad767081 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:30.731475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcc146-cc1e-488c-8612-232621b120a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:30.732111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcc146-cc1e-488c-8612-232621b120a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:30.732394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcc146-cc1e-488c-8612-232621b120a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:30.732669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcc146-cc1e-488c-8612-232621b120a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:30.733396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcc146-cc1e-488c-8612-232621b120a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:30.735330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcc146-cc1e-488c-8612-232621b120a0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:30.810174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 587/1175] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:27:30 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:27:33.075304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3aaa-db32-42ec-aeeb-36f53cd8409c None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.075831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3aaa-db32-42ec-aeeb-36f53cd8409c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.075831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3aaa-db32-42ec-aeeb-36f53cd8409c None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.077592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 589/1176] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:33.082853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c600bf4-42c8-4e24-9eef-3a41167a455c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.083260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c600bf4-42c8-4e24-9eef-3a41167a455c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.083411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c600bf4-42c8-4e24-9eef-3a41167a455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.101747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1c600bf4-42c8-4e24-9eef-3a41167a455c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:33.102968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1c600bf4-42c8-4e24-9eef-3a41167a455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:33.110460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 588/1177] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:33.139025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3aaa-db32-42ec-aeeb-36f53cd8409c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:33.150884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3aaa-db32-42ec-aeeb-36f53cd8409c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:33.155332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:33.156087 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.156356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.156620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.167585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:27:33.174137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:27:33.175293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 590/1178] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:27:33.181942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c600bf4-42c8-4e24-9eef-3a41167a455c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:33.190661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c600bf4-42c8-4e24-9eef-3a41167a455c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:33.196230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:33.196869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.197175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.197448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.198199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:33.198500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:33.200116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:33.208090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 589/1179] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:33.213624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:33.222911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1eb14-6325-491c-ab4f-231be5bfa6c8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:33.227281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:33.228093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.228385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.228654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] PATH_INFO: `/v3/users/7e308cc0aad64852aa7a20ffe76b93b7` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.356526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] RBAC: Authorizing `identity:get_user(user_id=7e308cc0aad64852aa7a20ffe76b93b7)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:33.358528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:33.360222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 591/1180] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:33 2022] GET /identity/v3/users/7e308cc0aad64852aa7a20ffe76b93b7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:33.365967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:33.376397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94cf4-1378-4099-9799-84cb5bb18467 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:33.380887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:33.381502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.381815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.382643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.390165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:33.391928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:33.401097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 590/1181] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:27:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:27:33.406764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:33.416552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd752cc9-a1b6-4f8e-bfdd-99b4e5244b64 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:33.420937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed92e6-7cb0-4ea9-a874-560a140bcfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:33.421744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed92e6-7cb0-4ea9-a874-560a140bcfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.422018 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed92e6-7cb0-4ea9-a874-560a140bcfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.422285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed92e6-7cb0-4ea9-a874-560a140bcfb8 admin admin] PATH_INFO: `/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.423500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed92e6-7cb0-4ea9-a874-560a140bcfb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a16f6be4e5d742e2b58811dcfdd579fc)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:33.425459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed92e6-7cb0-4ea9-a874-560a140bcfb8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:33.427119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 592/1182] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:33 2022] GET /identity/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:33.433220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:33.441648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef076fa-6d40-4dc3-89ed-95620d38375a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:33.446567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791e8a4-5e02-4540-bb96-57c7cffe222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:33.447203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e8a4-5e02-4540-bb96-57c7cffe222f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:33.447487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e8a4-5e02-4540-bb96-57c7cffe222f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:33.447760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791e8a4-5e02-4540-bb96-57c7cffe222f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:33.448577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791e8a4-5e02-4540-bb96-57c7cffe222f admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=a16f6be4e5d742e2b58811dcfdd579fc, user.id=7e308cc0aad64852aa7a20ffe76b93b7) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:33.448882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791e8a4-5e02-4540-bb96-57c7cffe222f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:33.450657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791e8a4-5e02-4540-bb96-57c7cffe222f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:33.455972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 591/1183] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:27:33 2022] GET /identity/v3/role_assignments?user.id=7e308cc0aad64852aa7a20ffe76b93b7&scope.project.id=a16f6be4e5d742e2b58811dcfdd579fc&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:35.627370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770427-69a9-4446-b3c0-e84b4dc018ed None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:35.627898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770427-69a9-4446-b3c0-e84b4dc018ed None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:35.627898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770427-69a9-4446-b3c0-e84b4dc018ed None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:35.629652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 593/1184] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:35.635426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcb6ab-b14e-4558-b4cc-9770ba48f7ee None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:35.635833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcb6ab-b14e-4558-b4cc-9770ba48f7ee None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:35.635974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcb6ab-b14e-4558-b4cc-9770ba48f7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:35.653747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-30bcb6ab-b14e-4558-b4cc-9770ba48f7ee None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:35.655217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-30bcb6ab-b14e-4558-b4cc-9770ba48f7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:35.662670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 592/1185] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:27:35.684951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770427-69a9-4446-b3c0-e84b4dc018ed None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:35.697313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770427-69a9-4446-b3c0-e84b4dc018ed None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:35.701508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:35.702255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:35.702526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:35.702811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:35.713346 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:27:35.719919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:27:35.721024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 594/1186] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:27:35.726501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcb6ab-b14e-4558-b4cc-9770ba48f7ee None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:35.735101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcb6ab-b14e-4558-b4cc-9770ba48f7ee None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:35.739523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:35.740157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:35.740434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:35.740704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:35.741677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:35.741803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:35.743337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:35.751278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 593/1187] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:35.756561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:35.767201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10a354-79cb-4aa3-bbdd-f5aaecd70f85 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:35.771614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:35.773164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:35.773796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:35.774067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] PATH_INFO: `/v3/users/7e308cc0aad64852aa7a20ffe76b93b7` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:35.775359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=7e308cc0aad64852aa7a20ffe76b93b7)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:35.777445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:35.778999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 595/1188] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:35 2022] GET /identity/v3/users/7e308cc0aad64852aa7a20ffe76b93b7 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:35.784344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:35.793681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c07b0f-7c76-4f7e-ad4f-f0ff702d0868 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:35.798071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb4d1-372e-464b-8af8-11a1d771aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:35.798913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb4d1-372e-464b-8af8-11a1d771aa10 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:35.799191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb4d1-372e-464b-8af8-11a1d771aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:35.799462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb4d1-372e-464b-8af8-11a1d771aa10 admin admin] PATH_INFO: `/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:35.800667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abb4d1-372e-464b-8af8-11a1d771aa10 admin admin] RBAC: Authorizing `identity:get_project(project_id=a16f6be4e5d742e2b58811dcfdd579fc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:35.802655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abb4d1-372e-464b-8af8-11a1d771aa10 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:35.804510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 594/1189] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:35 2022] GET /identity/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:35.809683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:35.818762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf8c85-4580-4dd9-aca6-3862078605d6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:35.824133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11d16d-6d6b-49d9-85fd-8b585ca2971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:35.824953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d16d-6d6b-49d9-85fd-8b585ca2971a admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:35.825226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d16d-6d6b-49d9-85fd-8b585ca2971a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:35.825492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11d16d-6d6b-49d9-85fd-8b585ca2971a admin admin] PATH_INFO: `/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc/users/7e308cc0aad64852aa7a20ffe76b93b7/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:35.827417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11d16d-6d6b-49d9-85fd-8b585ca2971a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16f6be4e5d742e2b58811dcfdd579fc, user_id=7e308cc0aad64852aa7a20ffe76b93b7, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:35.830049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11d16d-6d6b-49d9-85fd-8b585ca2971a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:35.897745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 596/1190] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:27:35 2022] PUT /identity/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc/users/7e308cc0aad64852aa7a20ffe76b93b7/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:27:38.081354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f697-5ec1-4273-859a-52c056ca4408 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.081881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f697-5ec1-4273-859a-52c056ca4408 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.081881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f697-5ec1-4273-859a-52c056ca4408 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.083684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 595/1191] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:27:38.090091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd57ee-7e08-4262-a656-17d22201d4dc None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.090535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd57ee-7e08-4262-a656-17d22201d4dc None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.090645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd57ee-7e08-4262-a656-17d22201d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.107750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9acd57ee-7e08-4262-a656-17d22201d4dc None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:27:38.108911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9acd57ee-7e08-4262-a656-17d22201d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:27:38.164758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 597/1192] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:27:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:27:38.188488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f697-5ec1-4273-859a-52c056ca4408 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:38.201027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f697-5ec1-4273-859a-52c056ca4408 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:38.205334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:38.206086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.206363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.206630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.217325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:27:38.223992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:27:38.225120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 596/1193] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:27:38.230816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd57ee-7e08-4262-a656-17d22201d4dc None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:38.239707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd57ee-7e08-4262-a656-17d22201d4dc None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:38.244331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:38.244960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.245233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.245499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.246237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:38.246532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:38.248135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:38.256024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 598/1194] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:38.262026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:38.271814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01db70-bc1e-468b-adce-e50d602a12dc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:38.277140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:38.277951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.278229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.278498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] PATH_INFO: `/v3/users/7e308cc0aad64852aa7a20ffe76b93b7` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.279957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] RBAC: Authorizing `identity:get_user(user_id=7e308cc0aad64852aa7a20ffe76b93b7)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:38.282045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:38.283599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 597/1195] 10.222.0.21 () {56 vars in 1198 bytes} [Mon Jan 31 04:27:38 2022] GET /identity/v3/users/7e308cc0aad64852aa7a20ffe76b93b7 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:38.288644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:38.297652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893f77d-0b28-4ce0-abe0-02df6854ffe8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:38.301980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:38.302569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.302877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.303150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.311080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:38.312788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:38.322174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 599/1196] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:27:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:27:38.327290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:38.336734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69ddd2-1e89-4396-856e-5cacb400effc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:38.341097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c4c69-fadb-4fff-9f72-bbb3d9a4b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:38.341891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4c69-fadb-4fff-9f72-bbb3d9a4b80d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.342168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4c69-fadb-4fff-9f72-bbb3d9a4b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.342439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4c69-fadb-4fff-9f72-bbb3d9a4b80d admin admin] PATH_INFO: `/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.343633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c4c69-fadb-4fff-9f72-bbb3d9a4b80d admin admin] RBAC: Authorizing `identity:get_project(project_id=a16f6be4e5d742e2b58811dcfdd579fc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:38.345603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c4c69-fadb-4fff-9f72-bbb3d9a4b80d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:38.347226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 598/1197] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:27:38 2022] GET /identity/v3/projects/a16f6be4e5d742e2b58811dcfdd579fc => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:27:38.353034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:27:38.361365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b36a6-600a-4388-af70-4caba8ad910b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:27:38.365790 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22c83-fcc8-4627-9cfe-00c56c18883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:27:38.367095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22c83-fcc8-4627-9cfe-00c56c18883c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:27:38.367373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22c83-fcc8-4627-9cfe-00c56c18883c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:27:38.367643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22c83-fcc8-4627-9cfe-00c56c18883c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:27:38.368454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22c83-fcc8-4627-9cfe-00c56c18883c admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=a16f6be4e5d742e2b58811dcfdd579fc, user.id=7e308cc0aad64852aa7a20ffe76b93b7) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:27:38.368755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22c83-fcc8-4627-9cfe-00c56c18883c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:27:38.370528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22c83-fcc8-4627-9cfe-00c56c18883c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:27:38.376074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 600/1198] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:27:38 2022] GET /identity/v3/role_assignments?user.id=7e308cc0aad64852aa7a20ffe76b93b7&scope.project.id=a16f6be4e5d742e2b58811dcfdd579fc&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:01.714505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba652a19-dc85-4537-b8e3-4dac1e4d5799 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:01.715126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba652a19-dc85-4537-b8e3-4dac1e4d5799 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:01.715126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba652a19-dc85-4537-b8e3-4dac1e4d5799 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:01.716839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 599/1199] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:01.722120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701263-f746-4275-8c22-b38eaf8547e2 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:01.722557 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701263-f746-4275-8c22-b38eaf8547e2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:01.722689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701263-f746-4275-8c22-b38eaf8547e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:01.740243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-61701263-f746-4275-8c22-b38eaf8547e2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:01.745470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-61701263-f746-4275-8c22-b38eaf8547e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:01.750151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 601/1200] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:01.776111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba652a19-dc85-4537-b8e3-4dac1e4d5799 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:01.788206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba652a19-dc85-4537-b8e3-4dac1e4d5799 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:01.792497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:01.793250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:01.793526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:01.793798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:01.804245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:01.806093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:01.822901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:01.825602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 600/1201] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:01.829855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701263-f746-4275-8c22-b38eaf8547e2 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:01.839320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701263-f746-4275-8c22-b38eaf8547e2 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:01.843732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0d8e7-ecb8-43c8-93fd-2cde74809575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:01.844362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d8e7-ecb8-43c8-93fd-2cde74809575 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:01.844634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d8e7-ecb8-43c8-93fd-2cde74809575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:01.844901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0d8e7-ecb8-43c8-93fd-2cde74809575 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:01.845650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0d8e7-ecb8-43c8-93fd-2cde74809575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:01.845946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0d8e7-ecb8-43c8-93fd-2cde74809575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:01.847541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0d8e7-ecb8-43c8-93fd-2cde74809575 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:01.858885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 602/1202] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:29:01.864250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:01.874201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5551-a193-4604-9fd0-95afa3db8b07 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:01.878964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0bc18-18c5-45f3-9050-ad3b250adefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:01.879614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0bc18-18c5-45f3-9050-ad3b250adefb admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:01.879887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0bc18-18c5-45f3-9050-ad3b250adefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:01.880156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0bc18-18c5-45f3-9050-ad3b250adefb admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:01.880880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0bc18-18c5-45f3-9050-ad3b250adefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:01.883576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0bc18-18c5-45f3-9050-ad3b250adefb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:02.036326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 601/1203] 10.222.0.21 () {60 vars in 1153 bytes} [Mon Jan 31 04:29:01 2022] POST /identity/v3/users => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:29:04.300704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18bad9-0ea6-4b5b-ba5b-3bc8183c5978 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.301285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18bad9-0ea6-4b5b-ba5b-3bc8183c5978 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.301285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18bad9-0ea6-4b5b-ba5b-3bc8183c5978 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.303075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 603/1204] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:04.308411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab596c-bf22-4eb8-a8b9-89de949bb078 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.308824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab596c-bf22-4eb8-a8b9-89de949bb078 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.308957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab596c-bf22-4eb8-a8b9-89de949bb078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.327837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-33ab596c-bf22-4eb8-a8b9-89de949bb078 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:04.329014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-33ab596c-bf22-4eb8-a8b9-89de949bb078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:04.337795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 602/1205] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:04.361751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18bad9-0ea6-4b5b-ba5b-3bc8183c5978 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.374645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18bad9-0ea6-4b5b-ba5b-3bc8183c5978 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.379081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.379840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.380117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.380384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.391811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:29:04.398720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:29:04.399868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 604/1206] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:04.405912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab596c-bf22-4eb8-a8b9-89de949bb078 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.415413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab596c-bf22-4eb8-a8b9-89de949bb078 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.419824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.420457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.420735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.421006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.421755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:04.422054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.423679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.432682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 603/1207] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:04.438193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.448763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247febf-c300-4b8d-8ee1-16811c165c5d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.453819 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.454584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.454890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.455159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.465183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.469133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.483329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:04.484463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 605/1208] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:04.490116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.500467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6097-13fc-4913-8020-1189ebe662bc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.505047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.505678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.505979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.507311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.508044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:04.508350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.509916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.522597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 604/1209] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:04.528325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.537829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb840d8-3fc1-4bea-827c-6365ccee24dc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.542244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.543038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.543313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.543576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.550781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.552795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.567420 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 31 04:29:04.569138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 606/1210] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:04.574766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.584657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4af13-bf83-421d-8263-9a759605fb51 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.589360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.589946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.590290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.590565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.591455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:04.591783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.593629 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.611348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 605/1211] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:29:04.617632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.627163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f365a92-0c26-4a1d-b5a0-b59bf3b7c734 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.632527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.633190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.633465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.633731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.641491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.644844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.651757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 607/1212] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:29:04.657544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.666855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df44a-3c3e-48a4-9799-cc3763fbac79 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.671404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.672174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.672452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.672725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.683676 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.685587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.702903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:04.704875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 606/1213] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:04.710596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.719348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f41c0-069d-48de-b481-543c2c5b18eb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.724148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.725286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.725569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.725829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.726554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:04.726862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.728424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.739822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 608/1214] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:04.745870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.755536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7796a4-4d49-4656-9ab1-c77a5c4a206b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.760303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.761072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.761354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.761628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.768564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.779660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.783533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:29:04.784678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 607/1215] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:04.791285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.801040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946ff4e-fddd-4546-a400-ad3e5ad75233 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.806215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d494a2b-014d-4ed2-b15a-e980198c224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.806895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d494a2b-014d-4ed2-b15a-e980198c224f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.814122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d494a2b-014d-4ed2-b15a-e980198c224f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.814122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d494a2b-014d-4ed2-b15a-e980198c224f admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.814122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d494a2b-014d-4ed2-b15a-e980198c224f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:04.814122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d494a2b-014d-4ed2-b15a-e980198c224f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.814122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d494a2b-014d-4ed2-b15a-e980198c224f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.821714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 609/1216] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:04.827465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:04.837820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca26658-c3b7-44a7-8bd8-06bf630f2576 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:04.842391 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8c410-546a-44af-ae1e-8b00f93b34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:04.842995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8c410-546a-44af-ae1e-8b00f93b34b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:04.843277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8c410-546a-44af-ae1e-8b00f93b34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:04.843550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8c410-546a-44af-ae1e-8b00f93b34b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:04.844379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8c410-546a-44af-ae1e-8b00f93b34b4 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=266e2e8a599a4348aa356c18e3d7f3f2) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:04.844683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8c410-546a-44af-ae1e-8b00f93b34b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:04.846563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8c410-546a-44af-ae1e-8b00f93b34b4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:04.852450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 608/1217] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:29:04 2022] GET /identity/v3/role_assignments?user.id=266e2e8a599a4348aa356c18e3d7f3f2&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:07.060732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086a08-3fc8-44a1-b730-47cd0fb10d0b None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.061267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086a08-3fc8-44a1-b730-47cd0fb10d0b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.061267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12086a08-3fc8-44a1-b730-47cd0fb10d0b None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.063085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 610/1218] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:07.068153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c8a6f-c204-41e9-89db-78aab3983f87 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.069217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c8a6f-c204-41e9-89db-78aab3983f87 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.075070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c8a6f-c204-41e9-89db-78aab3983f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.087111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ef2c8a6f-c204-41e9-89db-78aab3983f87 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:07.088287 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ef2c8a6f-c204-41e9-89db-78aab3983f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:07.095815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 609/1219] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:07.119294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12086a08-3fc8-44a1-b730-47cd0fb10d0b None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.131786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12086a08-3fc8-44a1-b730-47cd0fb10d0b None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.136158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.136917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.137193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.137461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.148406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:29:07.155406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:29:07.156515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 611/1220] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:07.162190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c8a6f-c204-41e9-89db-78aab3983f87 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.170948 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c8a6f-c204-41e9-89db-78aab3983f87 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.175421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.176064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.176340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.176607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.177362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:07.177661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.179325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.187248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 610/1221] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:07.192987 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.203236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e3d2e-8c69-43fa-b960-b7bcf6731ec1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.207684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.211353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.211353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.211353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.219701 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.221512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.238215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:07.240002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 612/1222] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:07.245271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.254703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d57628-a228-4aaa-9999-f881c1141e01 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.259933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.260571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.260850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.261123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.261870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:07.262167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.264785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.277102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 611/1223] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:07.282469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.292126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972fe1-dc34-47fc-b666-213d03903727 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.296606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.297414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.297736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.298007 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.305249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.307390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.321606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 31 04:29:07.322697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 613/1224] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:07.328416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.338978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9ab4-0308-451c-a9ff-fcb5f7d31001 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.343530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.344170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.344453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.344730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.345573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:07.345902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.347778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.364667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 612/1225] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:07.370962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.380740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5ccc0-fc01-4be1-a4c1-1e255dac2cff admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.385973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.389281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.389281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.389281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.397544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.399400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.417778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:07.418954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 614/1226] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:07.424377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.434425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c9a13-3487-495c-aeed-c8687432d251 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.439032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.439689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.439971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.440242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.440973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:07.441275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.442902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.454559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 613/1227] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:07.459920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.469261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904089af-8c7c-482a-aca7-f01e8102ff85 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.473708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.474455 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.474893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.475165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.481874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.483848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.497330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:29:07.498460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 615/1228] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:07.504105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.514461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e10162-b9ec-42ee-b9eb-c2f323650f6c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.519195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009f9b1-4342-4ba5-8318-f2f99cdd8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.519858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009f9b1-4342-4ba5-8318-f2f99cdd8b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.520144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009f9b1-4342-4ba5-8318-f2f99cdd8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.520413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009f9b1-4342-4ba5-8318-f2f99cdd8b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.521212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009f9b1-4342-4ba5-8318-f2f99cdd8b95 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:07.521558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009f9b1-4342-4ba5-8318-f2f99cdd8b95 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.523564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009f9b1-4342-4ba5-8318-f2f99cdd8b95 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.535716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 614/1229] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:07.541316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:07.551371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2c24c-f8b7-4a34-a9cc-4d856133c985 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:07.556434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81443196-c9d0-4c2e-ad69-5466e385fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:07.557262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443196-c9d0-4c2e-ad69-5466e385fd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:07.557540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443196-c9d0-4c2e-ad69-5466e385fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:07.557810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81443196-c9d0-4c2e-ad69-5466e385fd75 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/266e2e8a599a4348aa356c18e3d7f3f2/roles/a36d2857a03b44cc8c9eaad52457f4f3` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:07.572280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81443196-c9d0-4c2e-ad69-5466e385fd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=266e2e8a599a4348aa356c18e3d7f3f2, role_id=a36d2857a03b44cc8c9eaad52457f4f3)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:07.574947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81443196-c9d0-4c2e-ad69-5466e385fd75 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:07.649798 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 616/1230] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:29:07 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/266e2e8a599a4348aa356c18e3d7f3f2/roles/a36d2857a03b44cc8c9eaad52457f4f3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:29:09.835378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e333d-32cb-4c88-add2-bc453f2b7e33 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:09.835936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e333d-32cb-4c88-add2-bc453f2b7e33 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:09.835936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e333d-32cb-4c88-add2-bc453f2b7e33 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:09.837659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 615/1231] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:09.842973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeefb00-fc54-42b2-8094-b2a07f5fbf91 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:09.843371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeefb00-fc54-42b2-8094-b2a07f5fbf91 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:09.843522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeefb00-fc54-42b2-8094-b2a07f5fbf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:09.862093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ffeefb00-fc54-42b2-8094-b2a07f5fbf91 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:09.863356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ffeefb00-fc54-42b2-8094-b2a07f5fbf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:09.919958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 617/1232] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:09.944161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e333d-32cb-4c88-add2-bc453f2b7e33 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:09.956269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e333d-32cb-4c88-add2-bc453f2b7e33 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:09.961135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:09.961900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:09.962206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:09.962480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:09.972581 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:29:09.980127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 31 04:29:09.981275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 616/1233] 10.222.0.21 () {56 vars in 1123 bytes} [Mon Jan 31 04:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:09.987109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeefb00-fc54-42b2-8094-b2a07f5fbf91 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:09.996223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeefb00-fc54-42b2-8094-b2a07f5fbf91 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.000741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.001380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.001654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.001920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.002658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:10.002985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.004597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.013123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 618/1234] 10.222.0.21 () {56 vars in 1124 bytes} [Mon Jan 31 04:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:10.018597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.029722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946873c-8aa0-49eb-9452-7b5b61b0af62 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.034188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.034993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.035279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.035553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.045627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.047490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.064104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:10.065220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 617/1235] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:10.071372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.080945 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39856ad0-c348-4d40-b1e2-74aa30085f27 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.086728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.087353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.087632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.087903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.088630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:10.088928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.090564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.102472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 619/1236] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:10.108089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.117991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e269-83da-4c8e-a099-1d02ccdf3338 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.122583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.123388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.123667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.123937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.131693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.133723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.148261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 31 04:29:10.149362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 618/1237] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:10.155339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.165090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237cbf2-f407-45ad-b34a-e7de6eff6a2c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.169528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.170203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.170478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.170746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.171659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:10.171957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.173871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.190708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 620/1238] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:10.196874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.206536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf170b-5b41-4938-8d7d-fae7ec5ab62a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.211515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.212156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.212438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.212714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.220399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.222169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.231604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 619/1239] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:29:10.237224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.247579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ebbfb-921e-407b-b0e1-da227bc8adbe admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.252140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.252951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.253223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.253515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.263979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.265779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.282418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:10.283640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 621/1240] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:10.289757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.298495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01ac6e-ae7a-4209-aa64-7989069cecc5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.303825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.304453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.304734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.305010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.305758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:10.306064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.307718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.319164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 620/1241] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:10.324439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.333778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828e6d8-6c21-470f-a1af-e286822bd30e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.338351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.339082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.339357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.339627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.346864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.351664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.362120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:29:10.363294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 622/1242] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:10.369584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.379067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35ab49-6f40-405f-b517-dc795da5c3ee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.383720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7627-cae7-4069-89f1-a1befc161183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.384348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7627-cae7-4069-89f1-a1befc161183 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.384627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7627-cae7-4069-89f1-a1befc161183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.384901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7627-cae7-4069-89f1-a1befc161183 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.385691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7627-cae7-4069-89f1-a1befc161183 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:10.385995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7627-cae7-4069-89f1-a1befc161183 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.387851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7627-cae7-4069-89f1-a1befc161183 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.400325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 621/1243] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:10.406320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:10.417248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4066c-8c3d-4fe8-b9b9-661c3924ff7b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:10.421788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcd0eb-d47c-4388-a39d-b5c6a0c52b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:10.422403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd0eb-d47c-4388-a39d-b5c6a0c52b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:10.422744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd0eb-d47c-4388-a39d-b5c6a0c52b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:10.423047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcd0eb-d47c-4388-a39d-b5c6a0c52b69 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:10.423871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd0eb-d47c-4388-a39d-b5c6a0c52b69 admin admin] RBAC: Adding query filter params (role.id=a36d2857a03b44cc8c9eaad52457f4f3, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=266e2e8a599a4348aa356c18e3d7f3f2) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:10.424177 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd0eb-d47c-4388-a39d-b5c6a0c52b69 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:10.425993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcd0eb-d47c-4388-a39d-b5c6a0c52b69 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:10.431861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 623/1244] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:29:10 2022] GET /identity/v3/role_assignments?user.id=266e2e8a599a4348aa356c18e3d7f3f2&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=a36d2857a03b44cc8c9eaad52457f4f3 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:12.658514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98357c9-0e54-4902-87f1-d322b4c82f94 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.659066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98357c9-0e54-4902-87f1-d322b4c82f94 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.659066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98357c9-0e54-4902-87f1-d322b4c82f94 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.660817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 622/1245] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:12.666740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c053-8dd5-4ec9-804d-e9ab229255f2 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.667160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c053-8dd5-4ec9-804d-e9ab229255f2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.667357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c053-8dd5-4ec9-804d-e9ab229255f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.685025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-dfc0c053-8dd5-4ec9-804d-e9ab229255f2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:12.686279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dfc0c053-8dd5-4ec9-804d-e9ab229255f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:12.694163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 624/1246] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:12.718065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98357c9-0e54-4902-87f1-d322b4c82f94 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:12.730604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98357c9-0e54-4902-87f1-d322b4c82f94 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:12.734907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:12.735669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.735944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.736207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.746959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:29:12.753763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:29:12.754956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 623/1247] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:12.760687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c053-8dd5-4ec9-804d-e9ab229255f2 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:12.769575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c053-8dd5-4ec9-804d-e9ab229255f2 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:12.774784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:12.775450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.775730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.776004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.777067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:12.777390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:12.779003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:12.787871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 625/1248] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:12.793201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:12.804363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6f473-06a0-4079-8ffa-de116f916cbe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:12.808920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:12.809668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.809947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.810221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.820369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:12.822180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:12.838972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:12.840160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 624/1249] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:12.845724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:12.856335 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f794-1d19-4911-b999-00cfe8e48933 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:12.861001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:12.861640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.866429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.866429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.866429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:12.866429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:12.866429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:12.876552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 626/1250] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:12.881792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:12.891265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4217fa7-8134-477c-a883-b471f5ed49d6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:12.895726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:12.897035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.897314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.897586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.904919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:12.906937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:12.921712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 31 04:29:12.922834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 625/1251] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:12.928606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:12.938236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e13e4-e025-44da-a940-b59697181a02 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:12.943217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:12.943686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.943978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.944246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.945078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:12.945374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:12.947227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:12.965052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 627/1252] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Jan 31 04:29:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:12.970563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:12.980642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d618e63-9e53-446e-bfc7-d5c60e423029 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:12.985126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:12.987051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:12.987051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:12.987051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:12.993824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:12.995602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:13.004065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 626/1253] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:29:12 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:29:13.010351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:13.019874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080a60-e330-41d6-9fad-513ccd653f42 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:13.024955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:13.025704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:13.025976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:13.026242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:13.036718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:13.038562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:13.055045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:13.056307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 628/1254] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:13.061874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:13.071179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663c4ff-669d-49fa-905e-09f0fe08fdf7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:13.075660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:13.076286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:13.076563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:13.076836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:13.077558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:13.077858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:13.079466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:13.091985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 627/1255] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:13.097394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:13.106998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b9af6-f2b0-43f0-845c-52746276e849 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:13.111887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:13.112640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:13.112912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:13.113178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:13.119995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:13.121922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:13.135144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:29:13.136263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 629/1256] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:13.141913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:13.152441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03349b-737d-4ff8-bb56-22f417eec14d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:13.158114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640fc04-c7fa-4fe8-8c5e-b9d21eb41dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:13.158749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640fc04-c7fa-4fe8-8c5e-b9d21eb41dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:13.159059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640fc04-c7fa-4fe8-8c5e-b9d21eb41dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:13.159331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640fc04-c7fa-4fe8-8c5e-b9d21eb41dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:13.160130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640fc04-c7fa-4fe8-8c5e-b9d21eb41dc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:13.160438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640fc04-c7fa-4fe8-8c5e-b9d21eb41dc4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:13.162612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640fc04-c7fa-4fe8-8c5e-b9d21eb41dc4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:13.175529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 628/1257] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:13.181440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:13.191942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd78d01-0b6d-4a0e-9122-8beacd9c6ee6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:13.197045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d1357-0d71-4096-a4fa-44a4758aa61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:13.197650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1357-0d71-4096-a4fa-44a4758aa61b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:13.197921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1357-0d71-4096-a4fa-44a4758aa61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:13.198184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d1357-0d71-4096-a4fa-44a4758aa61b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:13.199028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1357-0d71-4096-a4fa-44a4758aa61b admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=266e2e8a599a4348aa356c18e3d7f3f2) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:13.199329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1357-0d71-4096-a4fa-44a4758aa61b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:13.201191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d1357-0d71-4096-a4fa-44a4758aa61b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:13.206395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 630/1258] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:29:13 2022] GET /identity/v3/role_assignments?user.id=266e2e8a599a4348aa356c18e3d7f3f2&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:15.393543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f5c69-6a5d-453b-9aa7-262bf0e15a0c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.394058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f5c69-6a5d-453b-9aa7-262bf0e15a0c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.394058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f5c69-6a5d-453b-9aa7-262bf0e15a0c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.395829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 629/1259] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:15.402096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d9f0-1d77-4f5f-b03e-8f71b2e8a0b0 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.402512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d9f0-1d77-4f5f-b03e-8f71b2e8a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.402639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d9f0-1d77-4f5f-b03e-8f71b2e8a0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.420744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c961d9f0-1d77-4f5f-b03e-8f71b2e8a0b0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:15.421916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c961d9f0-1d77-4f5f-b03e-8f71b2e8a0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:15.429761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 631/1260] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:15.453015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f5c69-6a5d-453b-9aa7-262bf0e15a0c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.465730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f5c69-6a5d-453b-9aa7-262bf0e15a0c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.470125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.470897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.471183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.471460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.481451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:29:15.488232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:29:15.489364 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 630/1261] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 31 04:29:15.495414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d9f0-1d77-4f5f-b03e-8f71b2e8a0b0 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.504334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d9f0-1d77-4f5f-b03e-8f71b2e8a0b0 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.509490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.510158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.510403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.516047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.516047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:15.516047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.516047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.521969 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 632/1262] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:15.527739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.537914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469bff0-670c-4762-9fe4-71032de83277 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.542399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.543192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.543471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.544770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.553596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.555447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.572023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:15.573145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 631/1263] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:15.578654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.589285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1c32-8b66-48f5-b3be-bb56ce61c17d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.593820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.594453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.594729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.595030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.595753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:15.596051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.597656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.609620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 633/1264] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:15.615695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.625354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3139f-887c-4487-9cbd-2e11a177d5ec admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.629940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.631485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.631765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.632036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.639197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.641243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.655251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 31 04:29:15.656313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 632/1265] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:15.661888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.671761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464d897-7276-4f5a-a7b7-ba52bcce2787 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.676249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.676878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.677155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.678470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.679350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:15.679656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.681463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.699337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 634/1266] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:29:15.704757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.714815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e5d45-3bc0-4556-8f01-6cc72a9719e8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.719289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.720046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.720321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.720588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.730732 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.732585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.749562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:15.750701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 633/1267] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:15.756875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.766496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7493b4-c697-4a54-b688-bba04edc7201 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.771173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.771808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.775855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.775855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.775855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:15.775855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.775855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.786355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 635/1268] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:15.791971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.801442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3101728-7dbc-4e77-a849-03a266c93786 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.806736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.807529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.807805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.808075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.814757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.816724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.829851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:29:15.831036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 634/1269] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:15.837034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.846653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40114986-4a8d-4440-a2e2-de2f7d410599 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.851470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1125982-96d0-4dc3-bbc6-c6afbfbd8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.852112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1125982-96d0-4dc3-bbc6-c6afbfbd8401 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.852456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1125982-96d0-4dc3-bbc6-c6afbfbd8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.852746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1125982-96d0-4dc3-bbc6-c6afbfbd8401 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.853465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1125982-96d0-4dc3-bbc6-c6afbfbd8401 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:15.853771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1125982-96d0-4dc3-bbc6-c6afbfbd8401 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.855663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1125982-96d0-4dc3-bbc6-c6afbfbd8401 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.868265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 636/1270] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:15.874288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:15.885781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb34710-6be8-48a0-97fe-1759dd356bdf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:15.890447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256ab06-8cec-4271-b394-19c96d97b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:15.891377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ab06-8cec-4271-b394-19c96d97b928 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:15.891697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ab06-8cec-4271-b394-19c96d97b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:15.891930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256ab06-8cec-4271-b394-19c96d97b928 admin admin] PATH_INFO: `/v3/projects/78afae1e6cc64db988476a8e22b35517/users/266e2e8a599a4348aa356c18e3d7f3f2/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:15.893888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256ab06-8cec-4271-b394-19c96d97b928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78afae1e6cc64db988476a8e22b35517, user_id=266e2e8a599a4348aa356c18e3d7f3f2, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:15.897115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256ab06-8cec-4271-b394-19c96d97b928 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:15.978494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 635/1271] 10.222.0.21 () {58 vars in 1460 bytes} [Mon Jan 31 04:29:15 2022] PUT /identity/v3/projects/78afae1e6cc64db988476a8e22b35517/users/266e2e8a599a4348aa356c18e3d7f3f2/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:29:18.159141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c4e28-774f-49ae-8cb6-6cd630d0924e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.159781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c4e28-774f-49ae-8cb6-6cd630d0924e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.159781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c4e28-774f-49ae-8cb6-6cd630d0924e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.161489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 637/1272] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:18.166625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e171e-66c9-4d7e-8ab8-229d9a4863e7 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.167090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e171e-66c9-4d7e-8ab8-229d9a4863e7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.167187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e171e-66c9-4d7e-8ab8-229d9a4863e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.185153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e12e171e-66c9-4d7e-8ab8-229d9a4863e7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:18.186353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e12e171e-66c9-4d7e-8ab8-229d9a4863e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:18.242528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 636/1273] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:29:18.266593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c4e28-774f-49ae-8cb6-6cd630d0924e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.279148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c4e28-774f-49ae-8cb6-6cd630d0924e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.283520 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.284279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.284602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.284877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.295615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 31 04:29:18.303021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 31 04:29:18.304184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 638/1274] 10.222.0.21 () {56 vars in 1117 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:18.310021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e171e-66c9-4d7e-8ab8-229d9a4863e7 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.319596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e171e-66c9-4d7e-8ab8-229d9a4863e7 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.324105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.331745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.331745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.331745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.331745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:18.331745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.331745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.336564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 637/1275] 10.222.0.21 () {56 vars in 1120 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:18.341953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.352614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7b772-fcfd-4ee5-a550-6ca223d7c204 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.357146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.357924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.358196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.358466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.369219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.371112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.387632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:18.388762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 639/1276] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:18.394374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.404635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a743977-f1cf-494d-9937-2b5d95f46576 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.409079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.409709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.409991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.410264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.411025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:18.411326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.413536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.424939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 638/1277] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:18.430985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.440646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182f0fd-4efa-40d8-bfa1-c31ef76fd2ec admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.445583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.446355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.446630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.446928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.454262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.456292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.470183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 31 04:29:18.472375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 640/1278] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:18.477547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.487207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04419658-1b2b-45af-903e-97adaf0996fc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.492758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.493393 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.493745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.493944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.494776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:18.500923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.500923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.514478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 639/1279] 10.222.0.21 () {56 vars in 1164 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:18.519877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.529760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd482eb-d92a-485c-b1e7-794aecca0e60 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.534300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.534948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.535228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.535499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.543702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.545419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.555392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 641/1280] 10.222.0.21 () {58 vars in 1324 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:29:18.561161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.571295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550b78-fe00-46b5-ab54-4dcc12ca613b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.576123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.576930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.577212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.577484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.587767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.589517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.607518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 31 04:29:18.608713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 640/1281] 10.222.0.21 () {56 vars in 1129 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:18.614072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.623407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587dd03-2684-4a40-aae6-ffc30331bed8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.627903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.628526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.628800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.629128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.629866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:18.630161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.631899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.643375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 642/1282] 10.222.0.21 () {56 vars in 1130 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:18.649471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.659306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bb7a0-879c-4fb7-b7e3-d619a4328f3d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.664548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.665323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.665603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.665875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.672704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.674690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.687444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING keystone.server.flask.application [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 31 04:29:18.688553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 641/1283] 10.222.0.21 () {56 vars in 1132 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:18.694220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.703683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be8dd5-0507-4264-936a-51869f3c0a4c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.708140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fef0a-4d85-47fe-9651-344299176ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.709287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fef0a-4d85-47fe-9651-344299176ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.709563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fef0a-4d85-47fe-9651-344299176ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.709833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fef0a-4d85-47fe-9651-344299176ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.710615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fef0a-4d85-47fe-9651-344299176ba0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:18.710956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fef0a-4d85-47fe-9651-344299176ba0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.712778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fef0a-4d85-47fe-9651-344299176ba0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.725102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 643/1284] 10.222.0.21 () {56 vars in 1169 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:18.730991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:18.741205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f901a21-6b6d-44cc-9e71-d4161ce7d2a4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:18.745682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc886f-bdf6-40de-ba3e-06b545217b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:18.746320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc886f-bdf6-40de-ba3e-06b545217b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:18.746582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc886f-bdf6-40de-ba3e-06b545217b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:18.746894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc886f-bdf6-40de-ba3e-06b545217b1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:18.747730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc886f-bdf6-40de-ba3e-06b545217b1a admin admin] RBAC: Adding query filter params (role.id=f5c4e6312eb74b58b1dff95923bbfde9, scope.project.id=78afae1e6cc64db988476a8e22b35517, user.id=266e2e8a599a4348aa356c18e3d7f3f2) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:18.748022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc886f-bdf6-40de-ba3e-06b545217b1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:18.749856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc886f-bdf6-40de-ba3e-06b545217b1a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:18.755561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 642/1285] 10.222.0.21 () {56 vars in 1395 bytes} [Mon Jan 31 04:29:18 2022] GET /identity/v3/role_assignments?user.id=266e2e8a599a4348aa356c18e3d7f3f2&scope.project.id=78afae1e6cc64db988476a8e22b35517&role.id=f5c4e6312eb74b58b1dff95923bbfde9 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:29:20.998431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8adb3f-afde-454d-ae65-26431890ae08 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:20.998991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8adb3f-afde-454d-ae65-26431890ae08 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:20.999198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8adb3f-afde-454d-ae65-26431890ae08 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:21.000781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 644/1286] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:29:21.006242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61680-a550-44cd-8214-6b9d1eda012a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:21.006653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61680-a550-44cd-8214-6b9d1eda012a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:21.006785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a61680-a550-44cd-8214-6b9d1eda012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:21.024656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-97a61680-a550-44cd-8214-6b9d1eda012a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:21.025817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-97a61680-a550-44cd-8214-6b9d1eda012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:21.033513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 643/1287] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:21.056254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8adb3f-afde-454d-ae65-26431890ae08 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:21.068694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8adb3f-afde-454d-ae65-26431890ae08 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:21.073171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:21.073997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:21.075629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:21.075629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:21.075629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:21.076814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:21.088301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 31 04:29:21.089480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 645/1288] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:29:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:21.095644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a61680-a550-44cd-8214-6b9d1eda012a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:21.105316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a61680-a550-44cd-8214-6b9d1eda012a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:21.109711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4a8e3-640f-4649-9642-16d2ece3c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:21.110389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a8e3-640f-4649-9642-16d2ece3c052 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:21.110661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a8e3-640f-4649-9642-16d2ece3c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:21.110965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4a8e3-640f-4649-9642-16d2ece3c052 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:21.111678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a8e3-640f-4649-9642-16d2ece3c052 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:21.111974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a8e3-640f-4649-9642-16d2ece3c052 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:21.113538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4a8e3-640f-4649-9642-16d2ece3c052 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:21.118260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 644/1289] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Jan 31 04:29:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:29:21.123675 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:21.133213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f7e05-7304-4d8a-a9ca-8f8fec1a8e5b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:21.137740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c15a6-8994-4fb6-ae79-8cba7614db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:21.138363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c15a6-8994-4fb6-ae79-8cba7614db97 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:21.138641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c15a6-8994-4fb6-ae79-8cba7614db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:21.138953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c15a6-8994-4fb6-ae79-8cba7614db97 admin admin] PATH_INFO: `/v3/services` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:21.139661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c15a6-8994-4fb6-ae79-8cba7614db97 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:21.139960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c15a6-8994-4fb6-ae79-8cba7614db97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:21.141575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c15a6-8994-4fb6-ae79-8cba7614db97 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:21.146425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 646/1290] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Jan 31 04:29:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:23.344955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde73ef2-8a71-414d-8a78-4bcdb066fae6 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:23.345464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde73ef2-8a71-414d-8a78-4bcdb066fae6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:23.345464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde73ef2-8a71-414d-8a78-4bcdb066fae6 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:23.347216 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 645/1291] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:23.352681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a9376-f4e2-4de7-bfd6-8e8a8055b886 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:23.353116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a9376-f4e2-4de7-bfd6-8e8a8055b886 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:23.353217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a9376-f4e2-4de7-bfd6-8e8a8055b886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:23.371091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-880a9376-f4e2-4de7-bfd6-8e8a8055b886 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:23.372262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-880a9376-f4e2-4de7-bfd6-8e8a8055b886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:23.379955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 647/1292] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:29:23.404250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde73ef2-8a71-414d-8a78-4bcdb066fae6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:23.416083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde73ef2-8a71-414d-8a78-4bcdb066fae6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:23.420383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21565a96-710d-476f-82a3-f061203ff337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:23.421008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565a96-710d-476f-82a3-f061203ff337 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:23.421283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565a96-710d-476f-82a3-f061203ff337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:23.421551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565a96-710d-476f-82a3-f061203ff337 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:23.422277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21565a96-710d-476f-82a3-f061203ff337 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:23.423314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-21565a96-710d-476f-82a3-f061203ff337 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:29:23.423314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:29:23.423314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:29:23.424182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21565a96-710d-476f-82a3-f061203ff337 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:23.519041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 646/1293] 10.222.0.21 () {60 vars in 1162 bytes} [Mon Jan 31 04:29:23 2022] POST /identity/v3/services => generated 246 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:29:25.717028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2d71-d7f2-4dc5-9f37-087f0ecc6b5d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:25.717564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2d71-d7f2-4dc5-9f37-087f0ecc6b5d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:25.717564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc2d71-d7f2-4dc5-9f37-087f0ecc6b5d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:25.719347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 648/1294] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:25.725375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef370-eb98-411e-8f63-e22a603a6d72 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:25.725776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef370-eb98-411e-8f63-e22a603a6d72 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:25.725960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef370-eb98-411e-8f63-e22a603a6d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:25.744360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a58ef370-eb98-411e-8f63-e22a603a6d72 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:25.745534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a58ef370-eb98-411e-8f63-e22a603a6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:25.762311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 647/1295] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:25 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:25.785829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2d71-d7f2-4dc5-9f37-087f0ecc6b5d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:25.798527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc2d71-d7f2-4dc5-9f37-087f0ecc6b5d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:25.803550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:25.804351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:25.804625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:25.804897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:25.805559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:25.807216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:25.817965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 31 04:29:25.819142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 649/1296] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:29:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:25.824947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef370-eb98-411e-8f63-e22a603a6d72 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:25.833719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef370-eb98-411e-8f63-e22a603a6d72 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:25.838352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:25.839053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:25.845583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:25.845583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:25.845583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:25.845583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:25.845583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:25.847325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 648/1297] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Jan 31 04:29:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:25.853361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:25.862865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691f7c0-443c-4ce9-9234-2455d7cb39d3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:25.868020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e79a28-9441-4526-97f7-68042b0ff764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:25.868644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e79a28-9441-4526-97f7-68042b0ff764 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:25.868924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e79a28-9441-4526-97f7-68042b0ff764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:25.869195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e79a28-9441-4526-97f7-68042b0ff764 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:25.869987 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e79a28-9441-4526-97f7-68042b0ff764 admin admin] RBAC: Adding query filter params (interface=public, service_id=44e13396f41b469493118846117173ae, region_id=RegionOne) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:25.870289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e79a28-9441-4526-97f7-68042b0ff764 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:25.871886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e79a28-9441-4526-97f7-68042b0ff764 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:25.876882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 650/1298] 10.222.0.21 () {56 vars in 1272 bytes} [Mon Jan 31 04:29:25 2022] GET /identity/v3/endpoints?service_id=44e13396f41b469493118846117173ae&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:25.882396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:25.891874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7105-bf5d-4c3d-9e6e-d033d6e32252 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:25.896325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2bc77-507b-457e-bca5-93cccae21f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:25.896955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2bc77-507b-457e-bca5-93cccae21f96 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:25.897233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2bc77-507b-457e-bca5-93cccae21f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:25.901634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2bc77-507b-457e-bca5-93cccae21f96 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:25.901634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2bc77-507b-457e-bca5-93cccae21f96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:25.901634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2bc77-507b-457e-bca5-93cccae21f96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:25.906567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 649/1299] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:29:25 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:29:28.084560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58ca6-32eb-4a85-8396-211f1d4284c4 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:28.085286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58ca6-32eb-4a85-8396-211f1d4284c4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:28.085286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58ca6-32eb-4a85-8396-211f1d4284c4 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:28.086833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 651/1300] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:29:28.092190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ace03-98ba-43ea-8510-d77d0e406a00 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:28.092610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ace03-98ba-43ea-8510-d77d0e406a00 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:28.092774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ace03-98ba-43ea-8510-d77d0e406a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:28.109946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-527ace03-98ba-43ea-8510-d77d0e406a00 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:29:28.111125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-527ace03-98ba-43ea-8510-d77d0e406a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:29:28.118813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 650/1301] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:29:28 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:29:28.142850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b58ca6-32eb-4a85-8396-211f1d4284c4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:28.155884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b58ca6-32eb-4a85-8396-211f1d4284c4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:28.160173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:28.160933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:28.161211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:28.161528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:28.162176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:28.163787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:28.174464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING keystone.server.flask.application [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 31 04:29:28.175780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 652/1302] 10.222.0.21 () {56 vars in 1138 bytes} [Mon Jan 31 04:29:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 31 04:29:28.181451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ace03-98ba-43ea-8510-d77d0e406a00 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:28.190240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ace03-98ba-43ea-8510-d77d0e406a00 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:28.195796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077bece-fe89-481c-8aa1-7825b2ec0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:28.196440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bece-fe89-481c-8aa1-7825b2ec0a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:28.196723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bece-fe89-481c-8aa1-7825b2ec0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:28.196995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077bece-fe89-481c-8aa1-7825b2ec0a76 admin admin] PATH_INFO: `/v3/services` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:28.197708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077bece-fe89-481c-8aa1-7825b2ec0a76 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:29:28.198009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077bece-fe89-481c-8aa1-7825b2ec0a76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:28.199615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077bece-fe89-481c-8aa1-7825b2ec0a76 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:28.204598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 651/1303] 10.222.0.21 () {56 vars in 1137 bytes} [Mon Jan 31 04:29:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:29:28.210944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:29:28.220782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005e42-256c-4b42-b7d8-2038480ae53b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:29:28.225240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93868e8-4c6e-42cf-a117-b311a4ac5832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:29:28.225850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93868e8-4c6e-42cf-a117-b311a4ac5832 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:29:28.226123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93868e8-4c6e-42cf-a117-b311a4ac5832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:29:28.226392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93868e8-4c6e-42cf-a117-b311a4ac5832 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:29:28.227168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93868e8-4c6e-42cf-a117-b311a4ac5832 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:29:28.228725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93868e8-4c6e-42cf-a117-b311a4ac5832 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:29:28.321261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 653/1304] 10.222.0.21 () {60 vars in 1165 bytes} [Mon Jan 31 04:29:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:36:58.085480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cecd08-11a9-4cc6-aa0c-ff97f5f2e161 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:36:58.086422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cecd08-11a9-4cc6-aa0c-ff97f5f2e161 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:36:58.086950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cecd08-11a9-4cc6-aa0c-ff97f5f2e161 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:36:58.088949 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 652/1305] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:36:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:36:58.098939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af4533-e33c-4293-b884-008133c9bbf9 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:36:58.100505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af4533-e33c-4293-b884-008133c9bbf9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:36:58.100983 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af4533-e33c-4293-b884-008133c9bbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:36:58.241558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-73af4533-e33c-4293-b884-008133c9bbf9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:36:58.243880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-73af4533-e33c-4293-b884-008133c9bbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:36:58.396248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 654/1306] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:36:58.419712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cecd08-11a9-4cc6-aa0c-ff97f5f2e161 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:36:58.421944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f8cecd08-11a9-4cc6-aa0c-ff97f5f2e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:36:58.553807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cecd08-11a9-4cc6-aa0c-ff97f5f2e161 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:36:58.654079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37163d50-1d30-4dcf-b6fe-d83dd6344b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:36:58.654579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163d50-1d30-4dcf-b6fe-d83dd6344b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:36:58.654886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163d50-1d30-4dcf-b6fe-d83dd6344b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:36:58.655156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163d50-1d30-4dcf-b6fe-d83dd6344b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:36:58.655894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37163d50-1d30-4dcf-b6fe-d83dd6344b79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:36:58.657738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37163d50-1d30-4dcf-b6fe-d83dd6344b79 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:36:58.677420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 653/1307] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:36:58 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:37:00.979074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c218-23c6-4798-b165-52258fcd1a98 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:00.979606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c218-23c6-4798-b165-52258fcd1a98 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:00.979606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c218-23c6-4798-b165-52258fcd1a98 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:00.981356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 655/1308] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:00.987838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4af6-4b0e-4ec9-84a4-abb911e77af4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:00.988225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4af6-4b0e-4ec9-84a4-abb911e77af4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:00.988389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4af6-4b0e-4ec9-84a4-abb911e77af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:01.073920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-97ce4af6-4b0e-4ec9-84a4-abb911e77af4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:01.075684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-97ce4af6-4b0e-4ec9-84a4-abb911e77af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:01.180874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 654/1309] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:01.207032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c218-23c6-4798-b165-52258fcd1a98 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:01.208549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-eba3c218-23c6-4798-b165-52258fcd1a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:01.377732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c218-23c6-4798-b165-52258fcd1a98 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:01.471686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a1017-3a57-4a1b-b0a0-3a2701384287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:01.472336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1017-3a57-4a1b-b0a0-3a2701384287 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:01.472617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1017-3a57-4a1b-b0a0-3a2701384287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:01.472881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a1017-3a57-4a1b-b0a0-3a2701384287 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:01.473614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a1017-3a57-4a1b-b0a0-3a2701384287 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:01.475493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a1017-3a57-4a1b-b0a0-3a2701384287 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:01.500879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 656/1310] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:37:01 2022] GET /identity/v3/projects => generated 2553 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:37:03.781913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12c14a-5b76-49e0-b81b-9591781e3908 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:03.781913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12c14a-5b76-49e0-b81b-9591781e3908 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:03.782454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12c14a-5b76-49e0-b81b-9591781e3908 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:03.783947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 655/1311] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:03.789282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b3a48-cf28-4038-bcd1-994f2c9525c5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:03.789689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b3a48-cf28-4038-bcd1-994f2c9525c5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:03.789787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b3a48-cf28-4038-bcd1-994f2c9525c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:03.853240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-466b3a48-cf28-4038-bcd1-994f2c9525c5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:03.854429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-466b3a48-cf28-4038-bcd1-994f2c9525c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:03.945298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 657/1312] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:03.994925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92b0c3-9604-4d0d-9275-1f242a73ba7f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:03.995217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92b0c3-9604-4d0d-9275-1f242a73ba7f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:03.995523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92b0c3-9604-4d0d-9275-1f242a73ba7f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:03.998187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 656/1313] 10.222.0.21 () {54 vars in 964 bytes} [Mon Jan 31 04:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:04.004178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6412cae-2459-4037-a054-46fdb0cb68ca None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:04.004465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6412cae-2459-4037-a054-46fdb0cb68ca None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:04.004740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6412cae-2459-4037-a054-46fdb0cb68ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:04.078831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b6412cae-2459-4037-a054-46fdb0cb68ca None None] MFA Rules not processed for user `889a6422677047b6a75d1480f156ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:04.079971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b6412cae-2459-4037-a054-46fdb0cb68ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:04.153953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 658/1314] 10.222.0.21 () {58 vars in 1061 bytes} [Mon Jan 31 04:37:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:04.163041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92b0c3-9604-4d0d-9275-1f242a73ba7f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:04.164549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9b92b0c3-9604-4d0d-9275-1f242a73ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:04.266583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92b0c3-9604-4d0d-9275-1f242a73ba7f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:04.336025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3121e1-9581-47ac-ae89-fae299fdbcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:04.336659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3121e1-9581-47ac-ae89-fae299fdbcaa service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:04.336941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3121e1-9581-47ac-ae89-fae299fdbcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:04.337215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3121e1-9581-47ac-ae89-fae299fdbcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:04.338866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7e3121e1-9581-47ac-ae89-fae299fdbcaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:04.444467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3121e1-9581-47ac-ae89-fae299fdbcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:04.445894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3121e1-9581-47ac-ae89-fae299fdbcaa service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:04.581204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 657/1315] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:07.033334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607d9f-a3d3-42dc-818c-ddcc42c113c2 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:07.033871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607d9f-a3d3-42dc-818c-ddcc42c113c2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:07.033871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43607d9f-a3d3-42dc-818c-ddcc42c113c2 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:07.035658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 659/1316] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:07.040757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:07.041200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:07.041295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:07.104500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:07.105701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:07.197437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 658/1317] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:07.230199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607d9f-a3d3-42dc-818c-ddcc42c113c2 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:07.232541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-43607d9f-a3d3-42dc-818c-ddcc42c113c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:07.352345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43607d9f-a3d3-42dc-818c-ddcc42c113c2 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:07.440908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7e83f-c491-47db-9437-04891e0bfcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:07.441748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7e83f-c491-47db-9437-04891e0bfcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:07.442027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7e83f-c491-47db-9437-04891e0bfcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:07.442298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7e83f-c491-47db-9437-04891e0bfcc0 admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:07.443236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7e83f-c491-47db-9437-04891e0bfcc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:07.445020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7e83f-c491-47db-9437-04891e0bfcc0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:07.446663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 660/1318] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:37:07 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:37:07.458770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:07.459987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:07.545497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fa7c8-e9b0-4a1d-a7b7-275119ff8588 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:07.616618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae2e0d-a955-4e82-85c3-cefa573f3711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:07.617445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2e0d-a955-4e82-85c3-cefa573f3711 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:07.617724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2e0d-a955-4e82-85c3-cefa573f3711 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:07.617993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae2e0d-a955-4e82-85c3-cefa573f3711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:07.619614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d5ae2e0d-a955-4e82-85c3-cefa573f3711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:07.726580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae2e0d-a955-4e82-85c3-cefa573f3711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:07.731855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae2e0d-a955-4e82-85c3-cefa573f3711 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:07.747784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 659/1319] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:10.464959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58619b6-4421-48ab-a803-efd303825174 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:10.465998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58619b6-4421-48ab-a803-efd303825174 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:10.466364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58619b6-4421-48ab-a803-efd303825174 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:10.469516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 661/1320] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:10.475749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:10.476158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:10.476298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:10.541480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:10.542680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:10.638454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 660/1321] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:10.674316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58619b6-4421-48ab-a803-efd303825174 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:10.675953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e58619b6-4421-48ab-a803-efd303825174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:10.801778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58619b6-4421-48ab-a803-efd303825174 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:10.891870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dac79a-8ea1-41bc-ae0e-224d592b963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:10.892713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dac79a-8ea1-41bc-ae0e-224d592b963a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:10.892988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dac79a-8ea1-41bc-ae0e-224d592b963a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:10.893255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dac79a-8ea1-41bc-ae0e-224d592b963a admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:10.903782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dac79a-8ea1-41bc-ae0e-224d592b963a admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:10.905827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dac79a-8ea1-41bc-ae0e-224d592b963a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:10.907550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 662/1322] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:37:10 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:37:10.919474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:10.920684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:11.008278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36f060-4355-4d97-8825-5b6f9bf56140 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:11.079542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda8c1b-fb43-4dc7-8a7f-d1dbfbf053eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:11.080106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda8c1b-fb43-4dc7-8a7f-d1dbfbf053eb service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:11.080390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda8c1b-fb43-4dc7-8a7f-d1dbfbf053eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:11.080665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda8c1b-fb43-4dc7-8a7f-d1dbfbf053eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:11.082309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ebda8c1b-fb43-4dc7-8a7f-d1dbfbf053eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:11.188155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda8c1b-fb43-4dc7-8a7f-d1dbfbf053eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:11.189575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda8c1b-fb43-4dc7-8a7f-d1dbfbf053eb service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:11.207242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 661/1323] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:14.206644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a741e-f813-4304-9559-775f341a137e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:14.207227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a741e-f813-4304-9559-775f341a137e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:14.207336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a741e-f813-4304-9559-775f341a137e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:14.209068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 663/1324] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:14.214460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ef0c-4563-4d29-97c1-4184f0d123d2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:14.214885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ef0c-4563-4d29-97c1-4184f0d123d2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:14.215050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ef0c-4563-4d29-97c1-4184f0d123d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:14.279100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a823ef0c-4563-4d29-97c1-4184f0d123d2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:14.280308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a823ef0c-4563-4d29-97c1-4184f0d123d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:14.372321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 662/1325] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:14.406953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a741e-f813-4304-9559-775f341a137e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:14.408479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4c3a741e-f813-4304-9559-775f341a137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:14.528913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a741e-f813-4304-9559-775f341a137e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:14.616662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cef9d-70e2-40ef-aeec-e66811d2cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:14.617494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cef9d-70e2-40ef-aeec-e66811d2cee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:14.617768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cef9d-70e2-40ef-aeec-e66811d2cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:14.618036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cef9d-70e2-40ef-aeec-e66811d2cee3 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:14.627589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cef9d-70e2-40ef-aeec-e66811d2cee3 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:14.629585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cef9d-70e2-40ef-aeec-e66811d2cee3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:14.631270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 664/1326] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:37:14 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:37:14.660117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75af50-4e03-4384-b653-2aa860335fd0 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:14.660428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75af50-4e03-4384-b653-2aa860335fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:14.660704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75af50-4e03-4384-b653-2aa860335fd0 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:14.662477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 663/1327] 10.222.0.21 () {54 vars in 964 bytes} [Mon Jan 31 04:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:14.668471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc79d9-8b65-4525-9327-244bc94d28ff None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:14.668753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc79d9-8b65-4525-9327-244bc94d28ff None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:14.676343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc79d9-8b65-4525-9327-244bc94d28ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:14.740849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-eedc79d9-8b65-4525-9327-244bc94d28ff None None] MFA Rules not processed for user `889a6422677047b6a75d1480f156ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:14.742033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-eedc79d9-8b65-4525-9327-244bc94d28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:14.814311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 665/1328] 10.222.0.21 () {58 vars in 1061 bytes} [Mon Jan 31 04:37:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:14.823312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75af50-4e03-4384-b653-2aa860335fd0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:14.825332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1b75af50-4e03-4384-b653-2aa860335fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:14.926375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75af50-4e03-4384-b653-2aa860335fd0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:14.996754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786408d-efc8-4c6f-a188-52464dcff533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:14.997577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786408d-efc8-4c6f-a188-52464dcff533 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:14.997892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786408d-efc8-4c6f-a188-52464dcff533 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:14.998171 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786408d-efc8-4c6f-a188-52464dcff533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:14.999815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7786408d-efc8-4c6f-a188-52464dcff533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:15.106573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786408d-efc8-4c6f-a188-52464dcff533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:15.108325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786408d-efc8-4c6f-a188-52464dcff533 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:15.125753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 664/1329] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:18.722203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b40d0-7b45-4376-8c9d-af96926cdb80 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:18.722774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b40d0-7b45-4376-8c9d-af96926cdb80 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:18.722774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b40d0-7b45-4376-8c9d-af96926cdb80 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:18.724564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 666/1330] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:18.729816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140273-ae59-425a-94d4-4058354903ce None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:18.730246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140273-ae59-425a-94d4-4058354903ce None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:18.730351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140273-ae59-425a-94d4-4058354903ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:18.794641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-30140273-ae59-425a-94d4-4058354903ce None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:18.795841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-30140273-ae59-425a-94d4-4058354903ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:18.889402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 665/1331] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:18.924585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b40d0-7b45-4376-8c9d-af96926cdb80 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:18.926079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4c0b40d0-7b45-4376-8c9d-af96926cdb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:19.028743 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b40d0-7b45-4376-8c9d-af96926cdb80 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:19.099952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b25f4-f3e8-4cd8-8c42-b2d7e6557af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:19.100626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b25f4-f3e8-4cd8-8c42-b2d7e6557af6 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:19.100885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b25f4-f3e8-4cd8-8c42-b2d7e6557af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:19.101151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b25f4-f3e8-4cd8-8c42-b2d7e6557af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:19.102745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d91b25f4-f3e8-4cd8-8c42-b2d7e6557af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:19.208876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b25f4-f3e8-4cd8-8c42-b2d7e6557af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:19.210331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b25f4-f3e8-4cd8-8c42-b2d7e6557af6 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:19.227856 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 667/1332] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:21.517573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0e11-cea0-4ce5-b4e7-f80f9532893b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:21.518137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0e11-cea0-4ce5-b4e7-f80f9532893b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:21.518233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0e11-cea0-4ce5-b4e7-f80f9532893b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:21.520261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 666/1333] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:21.525556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96997ae7-80bc-4e71-bf7c-a5add64d0cc4 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:21.525976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96997ae7-80bc-4e71-bf7c-a5add64d0cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:21.526259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96997ae7-80bc-4e71-bf7c-a5add64d0cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:21.590729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-96997ae7-80bc-4e71-bf7c-a5add64d0cc4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:21.592024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-96997ae7-80bc-4e71-bf7c-a5add64d0cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:21.686559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 668/1334] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:21.722682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0e11-cea0-4ce5-b4e7-f80f9532893b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:21.724235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e97e0e11-cea0-4ce5-b4e7-f80f9532893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:21.825215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0e11-cea0-4ce5-b4e7-f80f9532893b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:21.896126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e2b72-c740-4a25-9b55-e46dfe290f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:21.896763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2b72-c740-4a25-9b55-e46dfe290f46 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:21.897045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2b72-c740-4a25-9b55-e46dfe290f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:21.897318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e2b72-c740-4a25-9b55-e46dfe290f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:21.898965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2f9e2b72-c740-4a25-9b55-e46dfe290f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:22.004937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2b72-c740-4a25-9b55-e46dfe290f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:22.006369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e2b72-c740-4a25-9b55-e46dfe290f46 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:22.024198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 667/1335] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:24.304666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dbf8a-8f7d-47f4-b8ee-d065087705b3 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:24.305227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dbf8a-8f7d-47f4-b8ee-d065087705b3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:24.305227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dbf8a-8f7d-47f4-b8ee-d065087705b3 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:24.307113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 669/1336] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:24.312467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:24.312877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:24.313016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:24.376984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:24.378093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:24.473502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 668/1337] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:24.506922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dbf8a-8f7d-47f4-b8ee-d065087705b3 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:24.508439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a39dbf8a-8f7d-47f4-b8ee-d065087705b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:24.632120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dbf8a-8f7d-47f4-b8ee-d065087705b3 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:24.726702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cfeec-6ce7-4aa6-adfe-e18bda30cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:24.727568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cfeec-6ce7-4aa6-adfe-e18bda30cfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:24.727854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cfeec-6ce7-4aa6-adfe-e18bda30cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:24.728126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cfeec-6ce7-4aa6-adfe-e18bda30cfe7 admin admin] PATH_INFO: `/v3/projects/0d7b577b01e44156a30ea00705ebb430` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:24.738205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cfeec-6ce7-4aa6-adfe-e18bda30cfe7 admin admin] RBAC: Authorizing `identity:get_project(project_id=0d7b577b01e44156a30ea00705ebb430)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:24.740309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cfeec-6ce7-4aa6-adfe-e18bda30cfe7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:24.742174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 670/1338] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:37:24 2022] GET /identity/v3/projects/0d7b577b01e44156a30ea00705ebb430 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:37:24.753215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:24.754406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:24.843232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc845a-edb2-4d54-bb7d-ae65f92ba4df None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:24.914552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfffa2-33b3-40c3-933f-0ac915372c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:24.915151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfffa2-33b3-40c3-933f-0ac915372c9f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:24.915431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfffa2-33b3-40c3-933f-0ac915372c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:24.915702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfffa2-33b3-40c3-933f-0ac915372c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:24.917311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-00bfffa2-33b3-40c3-933f-0ac915372c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:25.023420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfffa2-33b3-40c3-933f-0ac915372c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:25.024855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfffa2-33b3-40c3-933f-0ac915372c9f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:25.042680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 669/1339] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:37:27.690095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0004289-59f0-4e58-a319-39c5f4d61ec4 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:27.690634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0004289-59f0-4e58-a319-39c5f4d61ec4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:27.690634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0004289-59f0-4e58-a319-39c5f4d61ec4 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:27.692405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 671/1340] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:27.697974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339202-67c8-4f2c-be9d-48b9d213c237 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:27.698403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339202-67c8-4f2c-be9d-48b9d213c237 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:27.698721 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339202-67c8-4f2c-be9d-48b9d213c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:27.769227 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b6339202-67c8-4f2c-be9d-48b9d213c237 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:27.770469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b6339202-67c8-4f2c-be9d-48b9d213c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:27.878241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 670/1341] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:27.912670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0004289-59f0-4e58-a319-39c5f4d61ec4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:27.914205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d0004289-59f0-4e58-a319-39c5f4d61ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:28.021081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0004289-59f0-4e58-a319-39c5f4d61ec4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:28.096009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c808ef8-2113-47e2-a5ce-7c3542f28481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:28.096663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808ef8-2113-47e2-a5ce-7c3542f28481 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:28.096944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808ef8-2113-47e2-a5ce-7c3542f28481 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:28.097217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808ef8-2113-47e2-a5ce-7c3542f28481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:28.098880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1c808ef8-2113-47e2-a5ce-7c3542f28481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:28.225366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c808ef8-2113-47e2-a5ce-7c3542f28481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:28.227649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c808ef8-2113-47e2-a5ce-7c3542f28481 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:28.258878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 672/1342] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:30.550923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab342-d05f-476b-bf93-dd2f2f66acbf None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:30.551495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab342-d05f-476b-bf93-dd2f2f66acbf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:30.551495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab342-d05f-476b-bf93-dd2f2f66acbf None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:30.553223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 671/1343] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:30.558345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:30.558814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:30.558923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:30.626477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:30.627693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:30.728666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 673/1344] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:30.763585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ab342-d05f-476b-bf93-dd2f2f66acbf None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:30.776739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ab342-d05f-476b-bf93-dd2f2f66acbf None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:30.781306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb5441-4ce5-4dac-a2f3-98d1281bd03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:30.782143 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5441-4ce5-4dac-a2f3-98d1281bd03a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:30.782418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5441-4ce5-4dac-a2f3-98d1281bd03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:30.782681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb5441-4ce5-4dac-a2f3-98d1281bd03a admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:30.783902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5441-4ce5-4dac-a2f3-98d1281bd03a admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:30.785690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb5441-4ce5-4dac-a2f3-98d1281bd03a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:30.787342 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 672/1345] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:37:30 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:37:30.799055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:30.800436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:30.890680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070b351-3f27-4423-80e2-665643a4a087 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:30.894486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffe568-7bb7-4ae9-9fb6-e1fc4a74d29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:30.895150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffe568-7bb7-4ae9-9fb6-e1fc4a74d29b service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:30.895429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffe568-7bb7-4ae9-9fb6-e1fc4a74d29b service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:30.895700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffe568-7bb7-4ae9-9fb6-e1fc4a74d29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:30.907895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffe568-7bb7-4ae9-9fb6-e1fc4a74d29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:30.909301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffe568-7bb7-4ae9-9fb6-e1fc4a74d29b service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:30.918490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 674/1346] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:33.735839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87a523-28fb-4adb-85c1-a1bb4cc67890 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:33.736372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87a523-28fb-4adb-85c1-a1bb4cc67890 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:33.736372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87a523-28fb-4adb-85c1-a1bb4cc67890 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:33.738137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 673/1347] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:33.743379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6724b-f236-4f05-a150-352dd48db85e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:33.743759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6724b-f236-4f05-a150-352dd48db85e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:33.743928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6724b-f236-4f05-a150-352dd48db85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:33.762279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b5d6724b-f236-4f05-a150-352dd48db85e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:33.763559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b5d6724b-f236-4f05-a150-352dd48db85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:33.771501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 675/1348] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:37:33.806476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87a523-28fb-4adb-85c1-a1bb4cc67890 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:33.817560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87a523-28fb-4adb-85c1-a1bb4cc67890 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:33.821032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366529d-3d62-4591-9511-f36d2c939083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:33.821653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366529d-3d62-4591-9511-f36d2c939083 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:33.821934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366529d-3d62-4591-9511-f36d2c939083 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:33.822208 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366529d-3d62-4591-9511-f36d2c939083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:33.831766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366529d-3d62-4591-9511-f36d2c939083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:33.833191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366529d-3d62-4591-9511-f36d2c939083 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:33.842559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 674/1349] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:38.208926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55621a-e539-43aa-84a8-03255d0db89d None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:38.209454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55621a-e539-43aa-84a8-03255d0db89d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:38.209454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55621a-e539-43aa-84a8-03255d0db89d None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:38.211245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 676/1350] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:38.216821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524fa8-b55c-48a3-ac2f-d759f3798aab None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:38.217259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524fa8-b55c-48a3-ac2f-d759f3798aab None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:38.217381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524fa8-b55c-48a3-ac2f-d759f3798aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:38.235503 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0f524fa8-b55c-48a3-ac2f-d759f3798aab None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:38.236623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0f524fa8-b55c-48a3-ac2f-d759f3798aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:38.244419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 675/1351] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:38.269210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55621a-e539-43aa-84a8-03255d0db89d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:38.281906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55621a-e539-43aa-84a8-03255d0db89d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:38.286367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd008294-12a4-4247-8528-1a7bc46999a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:38.287044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd008294-12a4-4247-8528-1a7bc46999a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:38.287326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd008294-12a4-4247-8528-1a7bc46999a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:38.287621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd008294-12a4-4247-8528-1a7bc46999a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:38.288361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd008294-12a4-4247-8528-1a7bc46999a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:38.290224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd008294-12a4-4247-8528-1a7bc46999a2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:38.305156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 677/1352] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:37:38 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:37:40.551257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f07b4f-cc1a-411b-99e7-78a8afbbf2fd None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:40.551793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f07b4f-cc1a-411b-99e7-78a8afbbf2fd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:40.551793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f07b4f-cc1a-411b-99e7-78a8afbbf2fd None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:40.553557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 676/1353] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:40.559147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a575e-7f25-4faa-97d5-e2d00c4aeeb7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:40.559601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a575e-7f25-4faa-97d5-e2d00c4aeeb7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:40.559854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a575e-7f25-4faa-97d5-e2d00c4aeeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:40.577213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-394a575e-7f25-4faa-97d5-e2d00c4aeeb7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:40.578396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-394a575e-7f25-4faa-97d5-e2d00c4aeeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:40.586087 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 678/1354] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:37:40.622230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f07b4f-cc1a-411b-99e7-78a8afbbf2fd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:40.634464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f07b4f-cc1a-411b-99e7-78a8afbbf2fd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:40.639095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381cece-b0af-492e-a2c2-5c78963305a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:40.639939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381cece-b0af-492e-a2c2-5c78963305a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:40.640222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381cece-b0af-492e-a2c2-5c78963305a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:40.640498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381cece-b0af-492e-a2c2-5c78963305a8 admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:40.641732 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381cece-b0af-492e-a2c2-5c78963305a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:40.643854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381cece-b0af-492e-a2c2-5c78963305a8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:40.645568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 677/1355] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:37:40 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:37:40.658518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a575e-7f25-4faa-97d5-e2d00c4aeeb7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:40.669562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a575e-7f25-4faa-97d5-e2d00c4aeeb7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:40.673256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3419d54-5a74-49d9-b5a5-fa33aa0f544b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:40.673946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3419d54-5a74-49d9-b5a5-fa33aa0f544b service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:40.674224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3419d54-5a74-49d9-b5a5-fa33aa0f544b service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:40.674496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3419d54-5a74-49d9-b5a5-fa33aa0f544b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:40.685074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3419d54-5a74-49d9-b5a5-fa33aa0f544b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:40.686524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3419d54-5a74-49d9-b5a5-fa33aa0f544b service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:40.696386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 679/1356] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:43.919086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f272-d611-4852-b349-6288bb84a36a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:43.919645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f272-d611-4852-b349-6288bb84a36a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:43.919645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f272-d611-4852-b349-6288bb84a36a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:43.921381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 678/1357] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:43.926594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1849-4be0-4f89-bcf8-f9d7e501cd1f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:43.927008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1849-4be0-4f89-bcf8-f9d7e501cd1f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:43.927199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1849-4be0-4f89-bcf8-f9d7e501cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:43.944935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-cf3b1849-4be0-4f89-bcf8-f9d7e501cd1f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:43.946121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-cf3b1849-4be0-4f89-bcf8-f9d7e501cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:43.954683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 680/1358] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:43.991750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912f272-d611-4852-b349-6288bb84a36a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:44.003009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912f272-d611-4852-b349-6288bb84a36a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:44.006387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb63c5-a5f6-448e-82a5-5bddabd05b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:44.007043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb63c5-a5f6-448e-82a5-5bddabd05b3b service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:44.007321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb63c5-a5f6-448e-82a5-5bddabd05b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:44.007589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb63c5-a5f6-448e-82a5-5bddabd05b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:44.017111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb63c5-a5f6-448e-82a5-5bddabd05b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:44.019085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb63c5-a5f6-448e-82a5-5bddabd05b3b service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:44.028916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 679/1359] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:48.478191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae383f22-b970-4f9e-a8bd-16603a936c3a None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:48.478739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae383f22-b970-4f9e-a8bd-16603a936c3a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:48.478739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae383f22-b970-4f9e-a8bd-16603a936c3a None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:48.481757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 681/1360] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:48.486474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6585c5-03cd-4b35-9941-058d217f2a81 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:48.487116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6585c5-03cd-4b35-9941-058d217f2a81 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:48.487116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6585c5-03cd-4b35-9941-058d217f2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:48.506030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8f6585c5-03cd-4b35-9941-058d217f2a81 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:48.507266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8f6585c5-03cd-4b35-9941-058d217f2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:48.516262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 680/1361] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:48.554675 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae383f22-b970-4f9e-a8bd-16603a936c3a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:37:48.565599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae383f22-b970-4f9e-a8bd-16603a936c3a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:37:48.569345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ed5b7-fe2a-4aa6-8798-898cd5eb6939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:37:48.570121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed5b7-fe2a-4aa6-8798-898cd5eb6939 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:48.570504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed5b7-fe2a-4aa6-8798-898cd5eb6939 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:48.570950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed5b7-fe2a-4aa6-8798-898cd5eb6939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:48.581015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ed5b7-fe2a-4aa6-8798-898cd5eb6939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:37:48.582541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ed5b7-fe2a-4aa6-8798-898cd5eb6939 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:37:48.593108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 682/1362] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:37:53.420398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107db82-4d43-43a8-beb5-948cd6a8e833 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:53.420854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107db82-4d43-43a8-beb5-948cd6a8e833 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:53.420955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107db82-4d43-43a8-beb5-948cd6a8e833 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:53.422718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 681/1363] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:37:53.428501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652eb7-c608-4248-aa40-a3b3822d6675 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:53.428918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652eb7-c608-4248-aa40-a3b3822d6675 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:53.429074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652eb7-c608-4248-aa40-a3b3822d6675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:53.509780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-af652eb7-c608-4248-aa40-a3b3822d6675 None None] MFA Rules not processed for user `266e2e8a599a4348aa356c18e3d7f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:53.510971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-af652eb7-c608-4248-aa40-a3b3822d6675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:53.630254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 683/1364] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:37:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:57.872233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0d3d-00ae-4fa6-ae0e-5c723bde8e85 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:57.873061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0d3d-00ae-4fa6-ae0e-5c723bde8e85 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:57.873350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0d3d-00ae-4fa6-ae0e-5c723bde8e85 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:57.875288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 682/1365] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:37:57.880207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e205-360e-4512-a330-b28a551f98d4 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:57.880627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e205-360e-4512-a330-b28a551f98d4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:57.880823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112e205-360e-4512-a330-b28a551f98d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:57.900378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a112e205-360e-4512-a330-b28a551f98d4 None None] MFA Rules not processed for user `266e2e8a599a4348aa356c18e3d7f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:57.901822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a112e205-360e-4512-a330-b28a551f98d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:57.910463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 684/1366] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:37:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:37:59.513123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8770-107e-49d7-86e5-ef375facff10 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:59.513704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8770-107e-49d7-86e5-ef375facff10 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:59.513704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f8770-107e-49d7-86e5-ef375facff10 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:59.515475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 683/1367] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:37:59.520757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13073-b245-45f3-a192-9bce8b8b5dd7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:37:59.521208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13073-b245-45f3-a192-9bce8b8b5dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:37:59.521483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d13073-b245-45f3-a192-9bce8b8b5dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:37:59.540286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-59d13073-b245-45f3-a192-9bce8b8b5dd7 None None] MFA Rules not processed for user `266e2e8a599a4348aa356c18e3d7f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:37:59.541728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-59d13073-b245-45f3-a192-9bce8b8b5dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:37:59.550638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 685/1368] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:37:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:38:03.464775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a66b-a18c-4c52-99c0-6df8e602ef48 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:03.465290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a66b-a18c-4c52-99c0-6df8e602ef48 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:03.465370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a66b-a18c-4c52-99c0-6df8e602ef48 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:03.467252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 684/1369] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:03.472174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd2ab-2c3c-4d09-94bf-cc758a4eff57 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:03.472553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd2ab-2c3c-4d09-94bf-cc758a4eff57 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:03.472705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccd2ab-2c3c-4d09-94bf-cc758a4eff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:03.490830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-1dccd2ab-2c3c-4d09-94bf-cc758a4eff57 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:03.492203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1dccd2ab-2c3c-4d09-94bf-cc758a4eff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:03.513861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 686/1370] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:03.553439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946f2ae-8ecd-4d18-bfb9-06b0beaada2c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:03.553782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946f2ae-8ecd-4d18-bfb9-06b0beaada2c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:03.553994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946f2ae-8ecd-4d18-bfb9-06b0beaada2c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:03.555781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 685/1371] 10.222.0.21 () {54 vars in 961 bytes} [Mon Jan 31 04:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:03.563095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c51ab-33f0-4adf-a0f7-a2a970b9e99e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:03.563584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c51ab-33f0-4adf-a0f7-a2a970b9e99e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:03.563959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c51ab-33f0-4adf-a0f7-a2a970b9e99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:03.615590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f26c51ab-33f0-4adf-a0f7-a2a970b9e99e None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:03.617005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f26c51ab-33f0-4adf-a0f7-a2a970b9e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:03.699614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 687/1372] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Jan 31 04:38:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:03.707564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946f2ae-8ecd-4d18-bfb9-06b0beaada2c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:03.723810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946f2ae-8ecd-4d18-bfb9-06b0beaada2c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:03.730128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920daf0e-8264-4f9b-9102-df795b344aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:03.730761 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920daf0e-8264-4f9b-9102-df795b344aa3 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:03.731079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920daf0e-8264-4f9b-9102-df795b344aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:03.731357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920daf0e-8264-4f9b-9102-df795b344aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:03.740090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920daf0e-8264-4f9b-9102-df795b344aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:03.741867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920daf0e-8264-4f9b-9102-df795b344aa3 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:03.751904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 686/1373] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:38:06.202916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f069442-b3ec-46a2-a12f-9b040ac09611 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:06.203484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f069442-b3ec-46a2-a12f-9b040ac09611 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:06.203484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f069442-b3ec-46a2-a12f-9b040ac09611 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:06.205363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 688/1374] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:06.210486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e998c-7494-4c8b-b0bc-89f9ed571682 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:06.210954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e998c-7494-4c8b-b0bc-89f9ed571682 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:06.211069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e998c-7494-4c8b-b0bc-89f9ed571682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:06.231516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-737e998c-7494-4c8b-b0bc-89f9ed571682 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:06.232859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-737e998c-7494-4c8b-b0bc-89f9ed571682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:06.241427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 687/1375] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:06.287700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f069442-b3ec-46a2-a12f-9b040ac09611 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:06.301984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f069442-b3ec-46a2-a12f-9b040ac09611 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:06.307600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ddf25-7050-468f-8e85-dd4e14d9427c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:06.308329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ddf25-7050-468f-8e85-dd4e14d9427c service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:06.308712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ddf25-7050-468f-8e85-dd4e14d9427c service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:06.309081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ddf25-7050-468f-8e85-dd4e14d9427c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:06.317228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ddf25-7050-468f-8e85-dd4e14d9427c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:06.318905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ddf25-7050-468f-8e85-dd4e14d9427c service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:06.328661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 689/1376] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:08.987319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937853-f1ac-4019-bc99-2f77d42d6fd2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:08.987844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937853-f1ac-4019-bc99-2f77d42d6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:08.987962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937853-f1ac-4019-bc99-2f77d42d6fd2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:08.989695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 688/1377] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:08.995507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5cb2e-c486-47e4-acde-73e8292f426c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:08.995953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5cb2e-c486-47e4-acde-73e8292f426c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:08.996046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5cb2e-c486-47e4-acde-73e8292f426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:09.014106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-57d5cb2e-c486-47e4-acde-73e8292f426c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:09.015334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-57d5cb2e-c486-47e4-acde-73e8292f426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:09.023375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 690/1378] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:09.068319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e273a-db0f-4c00-827f-3c645a4fbc0e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:09.068679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e273a-db0f-4c00-827f-3c645a4fbc0e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:09.069062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e273a-db0f-4c00-827f-3c645a4fbc0e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:09.071047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 689/1379] 10.222.0.21 () {54 vars in 961 bytes} [Mon Jan 31 04:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:09.077244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc96b-8c5b-4f1d-be3a-e76ec44a54f7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:09.077589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc96b-8c5b-4f1d-be3a-e76ec44a54f7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:09.077865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dc96b-8c5b-4f1d-be3a-e76ec44a54f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:09.096723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c50dc96b-8c5b-4f1d-be3a-e76ec44a54f7 None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:09.097923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c50dc96b-8c5b-4f1d-be3a-e76ec44a54f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:09.107672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 691/1380] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Jan 31 04:38:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:09.115367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e273a-db0f-4c00-827f-3c645a4fbc0e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:09.129951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e273a-db0f-4c00-827f-3c645a4fbc0e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:09.136243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b14f28-e6d0-48a1-94ca-fc17c2f9ac73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:09.136869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14f28-e6d0-48a1-94ca-fc17c2f9ac73 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:09.137151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14f28-e6d0-48a1-94ca-fc17c2f9ac73 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:09.137426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14f28-e6d0-48a1-94ca-fc17c2f9ac73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:09.147939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b14f28-e6d0-48a1-94ca-fc17c2f9ac73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:09.149946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b14f28-e6d0-48a1-94ca-fc17c2f9ac73 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:09.162743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 690/1381] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:11.530847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3c185-399b-4e68-b1f3-300e5a3bc0f2 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.531418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3c185-399b-4e68-b1f3-300e5a3bc0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.531418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3c185-399b-4e68-b1f3-300e5a3bc0f2 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.533117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 692/1382] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:11.538439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8821-6fa0-4ea8-9f59-ae24f4dd2d8a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.538904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8821-6fa0-4ea8-9f59-ae24f4dd2d8a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.539027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8821-6fa0-4ea8-9f59-ae24f4dd2d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.557872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-28fa8821-6fa0-4ea8-9f59-ae24f4dd2d8a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:11.559099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-28fa8821-6fa0-4ea8-9f59-ae24f4dd2d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:11.567266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 691/1383] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:11.653995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bae530-0a16-416c-8b10-5700e606ef1f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.654273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bae530-0a16-416c-8b10-5700e606ef1f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.654735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bae530-0a16-416c-8b10-5700e606ef1f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.656530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 693/1384] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:11.662288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d310-f4d2-4e2d-a8ec-a080c9038d6d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.662578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d310-f4d2-4e2d-a8ec-a080c9038d6d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.662885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d310-f4d2-4e2d-a8ec-a080c9038d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.683203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4b93d310-f4d2-4e2d-a8ec-a080c9038d6d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:11.684441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4b93d310-f4d2-4e2d-a8ec-a080c9038d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:11.694218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 692/1385] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:11.738338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bae530-0a16-416c-8b10-5700e606ef1f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:11.754179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bae530-0a16-416c-8b10-5700e606ef1f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:11.759697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940aafc-2550-4548-8f5c-f19c015a2fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:11.760353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940aafc-2550-4548-8f5c-f19c015a2fa8 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.760636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940aafc-2550-4548-8f5c-f19c015a2fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.760912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940aafc-2550-4548-8f5c-f19c015a2fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.769688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940aafc-2550-4548-8f5c-f19c015a2fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:11.771311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940aafc-2550-4548-8f5c-f19c015a2fa8 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:11.781264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 694/1386] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:11.827157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080871b-2644-4171-a43b-7ba37bb78a37 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.827443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080871b-2644-4171-a43b-7ba37bb78a37 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.827725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080871b-2644-4171-a43b-7ba37bb78a37 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.829579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 693/1387] 10.222.0.21 () {54 vars in 963 bytes} [Mon Jan 31 04:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:11.834785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abaa8d-e58a-4aea-aa78-24f77bd9e571 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.835104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abaa8d-e58a-4aea-aa78-24f77bd9e571 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.835378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abaa8d-e58a-4aea-aa78-24f77bd9e571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.885359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-25abaa8d-e58a-4aea-aa78-24f77bd9e571 None None] MFA Rules not processed for user `7b6b83d1d42045bdad91bf814b54a7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:11.886546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-25abaa8d-e58a-4aea-aa78-24f77bd9e571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:11.949370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 695/1388] 10.222.0.21 () {58 vars in 1060 bytes} [Mon Jan 31 04:38:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:11.956857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080871b-2644-4171-a43b-7ba37bb78a37 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:11.967747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080871b-2644-4171-a43b-7ba37bb78a37 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:11.971356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ae845-3513-4042-8606-0f7bb165efec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:11.971979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae845-3513-4042-8606-0f7bb165efec service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:11.972258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae845-3513-4042-8606-0f7bb165efec service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:11.972529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ae845-3513-4042-8606-0f7bb165efec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:11.983609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ae845-3513-4042-8606-0f7bb165efec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:11.985054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ae845-3513-4042-8606-0f7bb165efec service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:12.007884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 694/1389] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:14.209982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29972cc-384c-4e4b-aff6-917eb9adca75 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:14.210441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29972cc-384c-4e4b-aff6-917eb9adca75 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:14.210554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29972cc-384c-4e4b-aff6-917eb9adca75 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:14.212444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 696/1390] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:14.218545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d852-d7f2-4265-8276-4c3f616000d0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:14.219332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d852-d7f2-4265-8276-4c3f616000d0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:14.219736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d852-d7f2-4265-8276-4c3f616000d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:14.238031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d4a4d852-d7f2-4265-8276-4c3f616000d0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:14.239502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d4a4d852-d7f2-4265-8276-4c3f616000d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:14.247976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 695/1391] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:14.306632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29972cc-384c-4e4b-aff6-917eb9adca75 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:14.323132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29972cc-384c-4e4b-aff6-917eb9adca75 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:14.329735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a840-0a89-4ae7-a4db-d494b6570245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:14.330309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a840-0a89-4ae7-a4db-d494b6570245 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:14.330586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a840-0a89-4ae7-a4db-d494b6570245 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:14.330892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a840-0a89-4ae7-a4db-d494b6570245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:14.341172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a840-0a89-4ae7-a4db-d494b6570245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:14.343020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a840-0a89-4ae7-a4db-d494b6570245 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:14.354059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 697/1392] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:16.725901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38bf0-ed18-41b7-a7e2-401bc297b66b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:16.726425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38bf0-ed18-41b7-a7e2-401bc297b66b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:16.726425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38bf0-ed18-41b7-a7e2-401bc297b66b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:16.728220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 696/1393] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:16.734569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8acf-74bd-4427-ae33-3f6f2f3d6fe0 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:16.735021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8acf-74bd-4427-ae33-3f6f2f3d6fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:16.735187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8acf-74bd-4427-ae33-3f6f2f3d6fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:16.753901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-31da8acf-74bd-4427-ae33-3f6f2f3d6fe0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:16.755122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-31da8acf-74bd-4427-ae33-3f6f2f3d6fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:16.763606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 698/1394] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:16.808826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e38bf0-ed18-41b7-a7e2-401bc297b66b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:16.823512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e38bf0-ed18-41b7-a7e2-401bc297b66b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:16.829310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a5883-8c96-4471-ad98-076055847519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:16.830022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5883-8c96-4471-ad98-076055847519 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:16.830369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5883-8c96-4471-ad98-076055847519 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:16.830716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a5883-8c96-4471-ad98-076055847519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:16.839520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a5883-8c96-4471-ad98-076055847519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:16.841187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a5883-8c96-4471-ad98-076055847519 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:16.851113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 697/1395] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:19.232503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8ad-c553-4c37-ad83-45866233c852 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:19.233051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8ad-c553-4c37-ad83-45866233c852 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:19.233051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f8ad-c553-4c37-ad83-45866233c852 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:19.234840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 699/1396] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:19.240077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f5fcd-ba29-45a9-b974-80d2a805761f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:19.240461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f5fcd-ba29-45a9-b974-80d2a805761f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:19.240628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f5fcd-ba29-45a9-b974-80d2a805761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:19.258708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-353f5fcd-ba29-45a9-b974-80d2a805761f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:19.260693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-353f5fcd-ba29-45a9-b974-80d2a805761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:19.269052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 698/1397] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:19.311178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f8ad-c553-4c37-ad83-45866233c852 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:19.327334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f8ad-c553-4c37-ad83-45866233c852 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:19.333342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d28c56-9cc2-47f5-8ef1-50f258986e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:19.334123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28c56-9cc2-47f5-8ef1-50f258986e8d service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:19.334457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28c56-9cc2-47f5-8ef1-50f258986e8d service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:19.334675 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d28c56-9cc2-47f5-8ef1-50f258986e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:19.344878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d28c56-9cc2-47f5-8ef1-50f258986e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:19.347104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d28c56-9cc2-47f5-8ef1-50f258986e8d service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:19.357352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 700/1398] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:21.583380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605f992-6d9e-4eb9-9329-3de3ccb6628c None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:21.584073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605f992-6d9e-4eb9-9329-3de3ccb6628c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:21.584073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605f992-6d9e-4eb9-9329-3de3ccb6628c None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:21.585717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 699/1399] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:21.591858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545331-3920-47f6-b3ad-7ade7de096fa None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:21.592298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545331-3920-47f6-b3ad-7ade7de096fa None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:21.592403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545331-3920-47f6-b3ad-7ade7de096fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:21.612491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3c545331-3920-47f6-b3ad-7ade7de096fa None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:21.613993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3c545331-3920-47f6-b3ad-7ade7de096fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:21.625733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 701/1400] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:21.679974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605f992-6d9e-4eb9-9329-3de3ccb6628c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:21.699280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605f992-6d9e-4eb9-9329-3de3ccb6628c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:21.706547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc4570-185a-415b-861c-dfeb4dc6553e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:21.707378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4570-185a-415b-861c-dfeb4dc6553e service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:21.707796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4570-185a-415b-861c-dfeb4dc6553e service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:21.708175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc4570-185a-415b-861c-dfeb4dc6553e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:21.719138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc4570-185a-415b-861c-dfeb4dc6553e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:21.721223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc4570-185a-415b-861c-dfeb4dc6553e service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:21.734779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 700/1401] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:24.108318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad5d4-ece9-44eb-9646-2c32f6d00477 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:24.108977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad5d4-ece9-44eb-9646-2c32f6d00477 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:24.108977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaad5d4-ece9-44eb-9646-2c32f6d00477 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:24.110990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 702/1402] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:24.116323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510286e7-d481-48b6-a2af-725069243008 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:24.116782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510286e7-d481-48b6-a2af-725069243008 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:24.117043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510286e7-d481-48b6-a2af-725069243008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:24.136245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-510286e7-d481-48b6-a2af-725069243008 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:24.137449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-510286e7-d481-48b6-a2af-725069243008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:24.147245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 701/1403] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:24.191416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad5d4-ece9-44eb-9646-2c32f6d00477 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:24.205778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaad5d4-ece9-44eb-9646-2c32f6d00477 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:24.211067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730514da-7739-482f-a7ae-a10209be63db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:24.211681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730514da-7739-482f-a7ae-a10209be63db service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:24.211953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730514da-7739-482f-a7ae-a10209be63db service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:24.212231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730514da-7739-482f-a7ae-a10209be63db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:24.220600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730514da-7739-482f-a7ae-a10209be63db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:24.222176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730514da-7739-482f-a7ae-a10209be63db service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:24.232618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 703/1404] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:26.576124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9639c-4206-4e5b-a74d-c1b36603b300 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:26.576667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9639c-4206-4e5b-a74d-c1b36603b300 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:26.576667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9639c-4206-4e5b-a74d-c1b36603b300 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:26.578598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 702/1405] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:26.583694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748999-b720-411c-b41b-7ee39b9e9574 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:26.584083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748999-b720-411c-b41b-7ee39b9e9574 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:26.584248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e748999-b720-411c-b41b-7ee39b9e9574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:26.601894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-2e748999-b720-411c-b41b-7ee39b9e9574 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:26.603610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-2e748999-b720-411c-b41b-7ee39b9e9574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:26.611356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 704/1406] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:26.654825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9639c-4206-4e5b-a74d-c1b36603b300 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:26.669417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9639c-4206-4e5b-a74d-c1b36603b300 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:26.674841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc928a-63b3-4bfa-bd5c-213bcb6a931a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:26.675462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc928a-63b3-4bfa-bd5c-213bcb6a931a service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:26.675744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc928a-63b3-4bfa-bd5c-213bcb6a931a service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:26.676021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc928a-63b3-4bfa-bd5c-213bcb6a931a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:26.684810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc928a-63b3-4bfa-bd5c-213bcb6a931a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:26.694033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc928a-63b3-4bfa-bd5c-213bcb6a931a service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:26.696348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 703/1407] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:27.412756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075f554-4ac2-4889-a57e-c6c55f26d1c0 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:27.413039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075f554-4ac2-4889-a57e-c6c55f26d1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:27.413339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075f554-4ac2-4889-a57e-c6c55f26d1c0 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:27.415827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 705/1408] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:27.421369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f94b52-4cf1-4f75-b55d-c4caff6d7872 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:27.421662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f94b52-4cf1-4f75-b55d-c4caff6d7872 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:27.421937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f94b52-4cf1-4f75-b55d-c4caff6d7872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:27.440346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-25f94b52-4cf1-4f75-b55d-c4caff6d7872 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:27.441532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-25f94b52-4cf1-4f75-b55d-c4caff6d7872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:27.449293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 704/1409] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:27.505361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cd15c-1792-45df-8b78-d22b9daf0c86 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:27.505641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cd15c-1792-45df-8b78-d22b9daf0c86 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:27.508401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cd15c-1792-45df-8b78-d22b9daf0c86 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:27.508401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 706/1410] 10.222.0.21 () {54 vars in 962 bytes} [Mon Jan 31 04:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:27.513251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e60d-958e-479f-a4a3-ee70c17d9a3e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:27.513546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e60d-958e-479f-a4a3-ee70c17d9a3e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:27.513830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e60d-958e-479f-a4a3-ee70c17d9a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:27.563667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9ce0e60d-958e-479f-a4a3-ee70c17d9a3e None None] MFA Rules not processed for user `72317f5c187c41e9b2d1c53c9cedcd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:27.564856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9ce0e60d-958e-479f-a4a3-ee70c17d9a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:27.623952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 705/1411] 10.222.0.21 () {58 vars in 1059 bytes} [Mon Jan 31 04:38:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:27.631755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cd15c-1792-45df-8b78-d22b9daf0c86 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:27.642747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cd15c-1792-45df-8b78-d22b9daf0c86 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:27.646223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07957ca5-65dd-4240-8ebf-c8a125f9931e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72317f5c187c41e9b2d1c53c9cedcd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:27.646862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07957ca5-65dd-4240-8ebf-c8a125f9931e service glance] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:27.647138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07957ca5-65dd-4240-8ebf-c8a125f9931e service glance] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:27.647408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07957ca5-65dd-4240-8ebf-c8a125f9931e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:27.657430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07957ca5-65dd-4240-8ebf-c8a125f9931e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:27.658902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07957ca5-65dd-4240-8ebf-c8a125f9931e service glance] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:27.669271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 707/1412] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:28.226172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d791d-bf2e-440b-b284-e9e4a5ca0495 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:28.226465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d791d-bf2e-440b-b284-e9e4a5ca0495 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:28.226762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d791d-bf2e-440b-b284-e9e4a5ca0495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:28.274078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4a2d791d-bf2e-440b-b284-e9e4a5ca0495 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:28.275979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4a2d791d-bf2e-440b-b284-e9e4a5ca0495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:28.338402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 706/1413] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:28.380900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91257347-ab7d-4d4f-9292-d7f44fe1b5a4 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:28.381254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91257347-ab7d-4d4f-9292-d7f44fe1b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:28.381648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91257347-ab7d-4d4f-9292-d7f44fe1b5a4 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:28.383703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 708/1414] 10.222.0.21 () {54 vars in 942 bytes} [Mon Jan 31 04:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:28.391197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb85c-93b7-4752-8e4c-f2214a9e629e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:28.391484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb85c-93b7-4752-8e4c-f2214a9e629e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:28.391801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb85c-93b7-4752-8e4c-f2214a9e629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:28.440592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8bbdb85c-93b7-4752-8e4c-f2214a9e629e None None] MFA Rules not processed for user `77321e9c7ec34370b1b8246dde35911b`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:28.441792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8bbdb85c-93b7-4752-8e4c-f2214a9e629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:28.511675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 707/1415] 10.222.0.21 () {58 vars in 1039 bytes} [Mon Jan 31 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:28.521211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91257347-ab7d-4d4f-9292-d7f44fe1b5a4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:28.534718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91257347-ab7d-4d4f-9292-d7f44fe1b5a4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:28.539584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020e458-5855-4084-b32f-fc7a3e49146f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:28.540197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e458-5855-4084-b32f-fc7a3e49146f service swift] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:28.540559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e458-5855-4084-b32f-fc7a3e49146f service swift] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:28.540840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e458-5855-4084-b32f-fc7a3e49146f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:28.548950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020e458-5855-4084-b32f-fc7a3e49146f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:28.550554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020e458-5855-4084-b32f-fc7a3e49146f service swift] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:28.559134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 709/1416] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:38:29.099158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56632e-9574-4e02-a6ae-bfa8f2fc5e88 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:29.099687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56632e-9574-4e02-a6ae-bfa8f2fc5e88 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:29.099687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56632e-9574-4e02-a6ae-bfa8f2fc5e88 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:29.101481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 708/1417] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:29.106981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb26dd3-9aaa-43b1-92ed-4035492f8305 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:29.107429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb26dd3-9aaa-43b1-92ed-4035492f8305 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:29.107523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb26dd3-9aaa-43b1-92ed-4035492f8305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:29.125627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ebb26dd3-9aaa-43b1-92ed-4035492f8305 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:29.126810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ebb26dd3-9aaa-43b1-92ed-4035492f8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:29.135148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 710/1418] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:29.180108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56632e-9574-4e02-a6ae-bfa8f2fc5e88 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:29.201461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56632e-9574-4e02-a6ae-bfa8f2fc5e88 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:29.208280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c8fba-394d-4055-8019-10a631ad534e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:29.209102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8fba-394d-4055-8019-10a631ad534e service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:29.209685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8fba-394d-4055-8019-10a631ad534e service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:29.210139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c8fba-394d-4055-8019-10a631ad534e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:29.221627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c8fba-394d-4055-8019-10a631ad534e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:29.223286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c8fba-394d-4055-8019-10a631ad534e service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:29.233200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 709/1419] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:38:31.671597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175fb6e-55be-4b7b-aa63-8822777be224 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:31.672157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175fb6e-55be-4b7b-aa63-8822777be224 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:31.672157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175fb6e-55be-4b7b-aa63-8822777be224 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:31.673793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 711/1420] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:31.679544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf19fe-471f-409a-87f4-63b462ccb46d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:31.684432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf19fe-471f-409a-87f4-63b462ccb46d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:31.684432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf19fe-471f-409a-87f4-63b462ccb46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:31.699297 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-abbf19fe-471f-409a-87f4-63b462ccb46d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:31.700487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-abbf19fe-471f-409a-87f4-63b462ccb46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:31.715157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 710/1421] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:31.755681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175fb6e-55be-4b7b-aa63-8822777be224 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:31.771941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175fb6e-55be-4b7b-aa63-8822777be224 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:31.777763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b7196-186b-4808-88c1-849c210d5e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:31.778590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7196-186b-4808-88c1-849c210d5e06 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:31.779070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7196-186b-4808-88c1-849c210d5e06 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:31.779348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7196-186b-4808-88c1-849c210d5e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:31.788839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b7196-186b-4808-88c1-849c210d5e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:31.791454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b7196-186b-4808-88c1-849c210d5e06 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:31.801833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 712/1422] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:53.074771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a356-a4f8-42d1-9a18-a6b8edf876d4 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:53.075403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a356-a4f8-42d1-9a18-a6b8edf876d4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:53.075403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a356-a4f8-42d1-9a18-a6b8edf876d4 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:53.077101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 711/1423] 10.222.0.21 () {54 vars in 918 bytes} [Mon Jan 31 04:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:53.082339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284d4c-f3ec-426a-bab2-a438be4eb342 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:53.082840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284d4c-f3ec-426a-bab2-a438be4eb342 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:53.082957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284d4c-f3ec-426a-bab2-a438be4eb342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:53.101248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-97284d4c-f3ec-426a-bab2-a438be4eb342 None None] MFA Rules not processed for user `266e2e8a599a4348aa356c18e3d7f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:53.102409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-97284d4c-f3ec-426a-bab2-a438be4eb342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:53.111587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 713/1424] 10.222.0.21 () {58 vars in 1015 bytes} [Mon Jan 31 04:38:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:38:53.125825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e13df-8a08-4390-806e-fc1210ba51be None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:53.126102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e13df-8a08-4390-806e-fc1210ba51be None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:53.126372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e13df-8a08-4390-806e-fc1210ba51be None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:53.128240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 712/1425] 10.222.0.21 () {54 vars in 918 bytes} [Mon Jan 31 04:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:53.132660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0331b-8875-4400-bc58-91ac993820d4 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:53.132944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0331b-8875-4400-bc58-91ac993820d4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:53.133217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0331b-8875-4400-bc58-91ac993820d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:53.151602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7eb0331b-8875-4400-bc58-91ac993820d4 None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:53.152756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7eb0331b-8875-4400-bc58-91ac993820d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:53.161563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 714/1426] 10.222.0.21 () {58 vars in 1015 bytes} [Mon Jan 31 04:38:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:38:55.814319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd83903-1258-4fdb-9da1-64d81706fec9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:55.814907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd83903-1258-4fdb-9da1-64d81706fec9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:55.814907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd83903-1258-4fdb-9da1-64d81706fec9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:55.816623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 713/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:55.821860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be870d-260f-4042-8508-33bd5be5f1a7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:55.822482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be870d-260f-4042-8508-33bd5be5f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:55.822482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be870d-260f-4042-8508-33bd5be5f1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:55.841079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-42be870d-260f-4042-8508-33bd5be5f1a7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:55.842273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-42be870d-260f-4042-8508-33bd5be5f1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:55.849944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 715/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:55.891976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd83903-1258-4fdb-9da1-64d81706fec9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:55.906528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd83903-1258-4fdb-9da1-64d81706fec9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:55.911971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba03e5a-188d-4049-a410-0eea5b50d89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:55.912598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03e5a-188d-4049-a410-0eea5b50d89c service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:55.912879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03e5a-188d-4049-a410-0eea5b50d89c service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:55.913151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03e5a-188d-4049-a410-0eea5b50d89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:55.921958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba03e5a-188d-4049-a410-0eea5b50d89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:55.923582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba03e5a-188d-4049-a410-0eea5b50d89c service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:55.933591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 714/1429] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:57.292601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019532-d116-456d-9880-ad81ef415cab None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:57.293115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019532-d116-456d-9880-ad81ef415cab None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:57.293115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019532-d116-456d-9880-ad81ef415cab None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:57.294833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 716/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:57.299921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcd6f-d78e-4fb7-813e-632c4e383fdf None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:57.300324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcd6f-d78e-4fb7-813e-632c4e383fdf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:57.300481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdcd6f-d78e-4fb7-813e-632c4e383fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:57.318723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bbfdcd6f-d78e-4fb7-813e-632c4e383fdf None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:57.319952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bbfdcd6f-d78e-4fb7-813e-632c4e383fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:57.327697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 715/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:57.482705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019532-d116-456d-9880-ad81ef415cab None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:57.497414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019532-d116-456d-9880-ad81ef415cab None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:57.503013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00751c7-d0ad-4e43-ba08-cc61f26b75af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:57.503642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00751c7-d0ad-4e43-ba08-cc61f26b75af service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:57.503925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00751c7-d0ad-4e43-ba08-cc61f26b75af service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:57.504196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00751c7-d0ad-4e43-ba08-cc61f26b75af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:57.512558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00751c7-d0ad-4e43-ba08-cc61f26b75af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:57.514139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00751c7-d0ad-4e43-ba08-cc61f26b75af service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:57.523756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 717/1432] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:38:58.829974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9c73-04b5-4165-b86c-d210f8a04f17 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:58.830516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9c73-04b5-4165-b86c-d210f8a04f17 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:58.830516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9c73-04b5-4165-b86c-d210f8a04f17 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:58.832309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 716/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:38:58.837336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311200b3-3a1f-47f2-928a-d034bdf8c2a0 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:58.838396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311200b3-3a1f-47f2-928a-d034bdf8c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:58.838640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311200b3-3a1f-47f2-928a-d034bdf8c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:58.856362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-311200b3-3a1f-47f2-928a-d034bdf8c2a0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:38:58.857551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-311200b3-3a1f-47f2-928a-d034bdf8c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:38:58.865290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 718/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:38:59.017610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9c73-04b5-4165-b86c-d210f8a04f17 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:38:59.032396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9c73-04b5-4165-b86c-d210f8a04f17 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:38:59.037853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dc0b7-8296-459f-9497-56aafc900349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:38:59.038471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc0b7-8296-459f-9497-56aafc900349 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:38:59.038750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc0b7-8296-459f-9497-56aafc900349 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:38:59.039059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc0b7-8296-459f-9497-56aafc900349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:38:59.047033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc0b7-8296-459f-9497-56aafc900349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:38:59.048630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc0b7-8296-459f-9497-56aafc900349 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:38:59.058295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 717/1435] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:00.359654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cfca-11a4-4993-b867-7af677041fd3 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:00.360221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cfca-11a4-4993-b867-7af677041fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:00.360221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cfca-11a4-4993-b867-7af677041fd3 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:00.362050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 719/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:00.367027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c9a8a-ecb2-4529-951f-aa460239b2c2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:00.367473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c9a8a-ecb2-4529-951f-aa460239b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:00.367573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c9a8a-ecb2-4529-951f-aa460239b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:00.385745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-176c9a8a-ecb2-4529-951f-aa460239b2c2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:00.386964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-176c9a8a-ecb2-4529-951f-aa460239b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:00.394887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 718/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:00.546383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cfca-11a4-4993-b867-7af677041fd3 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:00.561257 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cfca-11a4-4993-b867-7af677041fd3 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:00.566603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376baf2-5331-4617-9ffe-5ad91dcffb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:00.567265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376baf2-5331-4617-9ffe-5ad91dcffb6b service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:00.567549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376baf2-5331-4617-9ffe-5ad91dcffb6b service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:00.567823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376baf2-5331-4617-9ffe-5ad91dcffb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:00.576731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376baf2-5331-4617-9ffe-5ad91dcffb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:00.578340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376baf2-5331-4617-9ffe-5ad91dcffb6b service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:00.587741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 720/1438] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:01.887695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e43e16-008c-45bb-ae3c-181fa803ef79 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:01.888145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e43e16-008c-45bb-ae3c-181fa803ef79 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:01.888240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e43e16-008c-45bb-ae3c-181fa803ef79 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:01.890010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 719/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:01.895308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ebd25-2b00-49e8-be49-3e9a263bd5b9 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:01.895726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ebd25-2b00-49e8-be49-3e9a263bd5b9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:01.895865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ebd25-2b00-49e8-be49-3e9a263bd5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:01.914246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-821ebd25-2b00-49e8-be49-3e9a263bd5b9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:01.915468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-821ebd25-2b00-49e8-be49-3e9a263bd5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:01.923419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 721/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:02.081885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e43e16-008c-45bb-ae3c-181fa803ef79 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:02.096048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e43e16-008c-45bb-ae3c-181fa803ef79 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:02.101283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d5b84-fd3f-4b53-96f5-03f6e0c97a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:02.101907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d5b84-fd3f-4b53-96f5-03f6e0c97a7f service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:02.102190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d5b84-fd3f-4b53-96f5-03f6e0c97a7f service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:02.102470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d5b84-fd3f-4b53-96f5-03f6e0c97a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:02.110907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d5b84-fd3f-4b53-96f5-03f6e0c97a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:02.112487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d5b84-fd3f-4b53-96f5-03f6e0c97a7f service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:02.122206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 720/1441] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:03.424485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d5d94-d506-49be-96da-1feb5a8e0fab None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:03.424998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d5d94-d506-49be-96da-1feb5a8e0fab None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:03.424998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d5d94-d506-49be-96da-1feb5a8e0fab None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:03.426691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 722/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:03.432365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915b3b-c732-40a7-88f7-ea34e9960caa None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:03.432806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915b3b-c732-40a7-88f7-ea34e9960caa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:03.432902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915b3b-c732-40a7-88f7-ea34e9960caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:03.450919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-18915b3b-c732-40a7-88f7-ea34e9960caa None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:03.452103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-18915b3b-c732-40a7-88f7-ea34e9960caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:03.459853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 721/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:03.613755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d5d94-d506-49be-96da-1feb5a8e0fab None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:03.629033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d5d94-d506-49be-96da-1feb5a8e0fab None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:03.634689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70230a-a04f-4701-a15c-de5e6c90f135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:03.635382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70230a-a04f-4701-a15c-de5e6c90f135 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:03.635662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70230a-a04f-4701-a15c-de5e6c90f135 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:03.635935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70230a-a04f-4701-a15c-de5e6c90f135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:03.644259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70230a-a04f-4701-a15c-de5e6c90f135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:03.645850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70230a-a04f-4701-a15c-de5e6c90f135 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:03.655778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 723/1444] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:04.964983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a1b9-8de1-4337-8ffc-16f876aa7782 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:04.965530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a1b9-8de1-4337-8ffc-16f876aa7782 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:04.965530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a1b9-8de1-4337-8ffc-16f876aa7782 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:04.967327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 722/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:04.972278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31488226-257e-40fd-967f-0661577af2f5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:04.972687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31488226-257e-40fd-967f-0661577af2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:04.972827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31488226-257e-40fd-967f-0661577af2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:04.990981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-31488226-257e-40fd-967f-0661577af2f5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:04.997938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-31488226-257e-40fd-967f-0661577af2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:05.000671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 724/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:05.154341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2a1b9-8de1-4337-8ffc-16f876aa7782 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:05.169395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2a1b9-8de1-4337-8ffc-16f876aa7782 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:05.174660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d0473-17d2-4b87-8d08-4f204690990e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:05.175308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0473-17d2-4b87-8d08-4f204690990e service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:05.175586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0473-17d2-4b87-8d08-4f204690990e service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:05.175858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0473-17d2-4b87-8d08-4f204690990e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:05.183952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d0473-17d2-4b87-8d08-4f204690990e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:05.185524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d0473-17d2-4b87-8d08-4f204690990e service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:05.194545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 723/1447] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:06.511065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22b72-7cbc-45ae-b6aa-70c3083d3227 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:06.511846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22b72-7cbc-45ae-b6aa-70c3083d3227 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:06.511846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e22b72-7cbc-45ae-b6aa-70c3083d3227 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:06.513684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 725/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:39:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:06.519390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce23c8-d52e-4037-8e94-ca0f0f50a7b2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:06.519917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce23c8-d52e-4037-8e94-ca0f0f50a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:06.520021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce23c8-d52e-4037-8e94-ca0f0f50a7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:06.538796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5cce23c8-d52e-4037-8e94-ca0f0f50a7b2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:06.540008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5cce23c8-d52e-4037-8e94-ca0f0f50a7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:06.548547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 724/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:06.702510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22b72-7cbc-45ae-b6aa-70c3083d3227 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:06.717619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e22b72-7cbc-45ae-b6aa-70c3083d3227 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:06.722949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a5bd0-75e4-4d07-ae60-9a6ee027a753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:06.723566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a5bd0-75e4-4d07-ae60-9a6ee027a753 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:06.723842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a5bd0-75e4-4d07-ae60-9a6ee027a753 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:06.724112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a5bd0-75e4-4d07-ae60-9a6ee027a753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:06.732989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a5bd0-75e4-4d07-ae60-9a6ee027a753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:06.734565 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a5bd0-75e4-4d07-ae60-9a6ee027a753 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:06.744110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 726/1450] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:08.037672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde4ebb-0e31-49ee-8afe-466398177a30 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:08.038222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde4ebb-0e31-49ee-8afe-466398177a30 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:08.038222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde4ebb-0e31-49ee-8afe-466398177a30 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:08.040126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 725/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:08.045859 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cefa4b-649f-4a2a-947d-1d98f92ff2a3 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:08.046284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cefa4b-649f-4a2a-947d-1d98f92ff2a3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:08.046430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cefa4b-649f-4a2a-947d-1d98f92ff2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:08.064103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-77cefa4b-649f-4a2a-947d-1d98f92ff2a3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:08.065280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-77cefa4b-649f-4a2a-947d-1d98f92ff2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:08.072952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 727/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:08.228732 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde4ebb-0e31-49ee-8afe-466398177a30 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:08.242517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde4ebb-0e31-49ee-8afe-466398177a30 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:08.247774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3d47-52b2-4335-9dc1-58700fc6d6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:08.248422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3d47-52b2-4335-9dc1-58700fc6d6e4 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:08.248702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3d47-52b2-4335-9dc1-58700fc6d6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:08.248999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3d47-52b2-4335-9dc1-58700fc6d6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:08.256717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3d47-52b2-4335-9dc1-58700fc6d6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:08.258270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3d47-52b2-4335-9dc1-58700fc6d6e4 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:08.267816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 726/1453] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:10.400511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f919-848d-4d5c-ae11-9dd6b603b3c0 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:10.401100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f919-848d-4d5c-ae11-9dd6b603b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:10.401100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f919-848d-4d5c-ae11-9dd6b603b3c0 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:10.402846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 728/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:10.408231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82047cb-3f86-4092-8bd2-0d88c0dd538f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:10.408674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82047cb-3f86-4092-8bd2-0d88c0dd538f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:10.408794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82047cb-3f86-4092-8bd2-0d88c0dd538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:10.426886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f82047cb-3f86-4092-8bd2-0d88c0dd538f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:10.428077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f82047cb-3f86-4092-8bd2-0d88c0dd538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:10.435961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 727/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:10.474344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f919-848d-4d5c-ae11-9dd6b603b3c0 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:10.484915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f919-848d-4d5c-ae11-9dd6b603b3c0 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:10.488323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1150a2f-a2e1-4a79-b9e6-88f447cf3187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:10.488935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150a2f-a2e1-4a79-b9e6-88f447cf3187 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:10.489207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150a2f-a2e1-4a79-b9e6-88f447cf3187 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:10.489472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150a2f-a2e1-4a79-b9e6-88f447cf3187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:10.498642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1150a2f-a2e1-4a79-b9e6-88f447cf3187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:10.500078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1150a2f-a2e1-4a79-b9e6-88f447cf3187 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:10.509654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 729/1456] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:12.854334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338fc3d-43ed-4780-b57d-08adc9258e7a None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:12.854925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338fc3d-43ed-4780-b57d-08adc9258e7a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:12.854925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338fc3d-43ed-4780-b57d-08adc9258e7a None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:12.856678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 728/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:12.861883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857fea-a05e-45c4-a7ce-9bd4fa294d8b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:12.862330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857fea-a05e-45c4-a7ce-9bd4fa294d8b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:12.862462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857fea-a05e-45c4-a7ce-9bd4fa294d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:12.879891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9c857fea-a05e-45c4-a7ce-9bd4fa294d8b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:12.881084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9c857fea-a05e-45c4-a7ce-9bd4fa294d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:12.888702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 730/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:12.927576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338fc3d-43ed-4780-b57d-08adc9258e7a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:12.938015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338fc3d-43ed-4780-b57d-08adc9258e7a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:12.941508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2611f5-ccf0-4cf8-be62-d5aef150de4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:12.942125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2611f5-ccf0-4cf8-be62-d5aef150de4f service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:12.942404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2611f5-ccf0-4cf8-be62-d5aef150de4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:12.942675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2611f5-ccf0-4cf8-be62-d5aef150de4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:12.952008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2611f5-ccf0-4cf8-be62-d5aef150de4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:12.953428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2611f5-ccf0-4cf8-be62-d5aef150de4f service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:12.963166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 729/1459] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:39:15.580726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa467-4b1f-47b2-b2f5-d310483e99a0 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:15.581292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa467-4b1f-47b2-b2f5-d310483e99a0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:15.581292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa467-4b1f-47b2-b2f5-d310483e99a0 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:15.583173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 731/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:15.589048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7c3b4-5e2c-4d9e-a14f-28e2bc08c7d2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:15.589438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7c3b4-5e2c-4d9e-a14f-28e2bc08c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:15.589590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7c3b4-5e2c-4d9e-a14f-28e2bc08c7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:15.607477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-70e7c3b4-5e2c-4d9e-a14f-28e2bc08c7d2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:15.608659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-70e7c3b4-5e2c-4d9e-a14f-28e2bc08c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:15.616241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 730/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:15.657671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa467-4b1f-47b2-b2f5-d310483e99a0 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:15.667991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa467-4b1f-47b2-b2f5-d310483e99a0 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:15.671375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237893-b7a4-4a34-8e1d-18019a496acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:15.671985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237893-b7a4-4a34-8e1d-18019a496acc service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:15.672266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237893-b7a4-4a34-8e1d-18019a496acc service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:15.672534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237893-b7a4-4a34-8e1d-18019a496acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:15.681559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53237893-b7a4-4a34-8e1d-18019a496acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:15.683008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53237893-b7a4-4a34-8e1d-18019a496acc service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:15.691876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 732/1462] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:18.016827 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbfc83-ceb3-441a-bc40-482c99997338 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:18.017373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbfc83-ceb3-441a-bc40-482c99997338 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:18.017373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbfc83-ceb3-441a-bc40-482c99997338 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:18.019146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 731/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:18.024343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab1dd-1d0c-4a35-906e-4b32e701e227 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:18.024852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab1dd-1d0c-4a35-906e-4b32e701e227 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:18.024963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab1dd-1d0c-4a35-906e-4b32e701e227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:18.042513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-4a5ab1dd-1d0c-4a35-906e-4b32e701e227 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:18.043729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4a5ab1dd-1d0c-4a35-906e-4b32e701e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:18.051380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 733/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:18.090855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbfc83-ceb3-441a-bc40-482c99997338 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:18.101470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbfc83-ceb3-441a-bc40-482c99997338 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:18.105036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160527c3-e4ca-44bd-a148-3a43104c4d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:18.105656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160527c3-e4ca-44bd-a148-3a43104c4d42 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:18.105939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160527c3-e4ca-44bd-a148-3a43104c4d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:18.106213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160527c3-e4ca-44bd-a148-3a43104c4d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:18.116264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160527c3-e4ca-44bd-a148-3a43104c4d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:18.117684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160527c3-e4ca-44bd-a148-3a43104c4d42 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:18.127451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 732/1465] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:20.393473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f366f0-40ea-4617-a885-576500cdae45 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:20.394014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f366f0-40ea-4617-a885-576500cdae45 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:20.394014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f366f0-40ea-4617-a885-576500cdae45 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:20.395904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 734/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:20.401266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff9e-e7fe-4642-bba3-99974a01a4e6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:20.401676 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff9e-e7fe-4642-bba3-99974a01a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:20.401822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff9e-e7fe-4642-bba3-99974a01a4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:20.419663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-def3ff9e-e7fe-4642-bba3-99974a01a4e6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:20.420842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-def3ff9e-e7fe-4642-bba3-99974a01a4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:20.428456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 733/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:20.467579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f366f0-40ea-4617-a885-576500cdae45 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:20.479073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f366f0-40ea-4617-a885-576500cdae45 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:20.482495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968c701-001a-49fd-bde5-c9a9e496ad57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:20.483159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968c701-001a-49fd-bde5-c9a9e496ad57 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:20.483441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968c701-001a-49fd-bde5-c9a9e496ad57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:20.483739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968c701-001a-49fd-bde5-c9a9e496ad57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:20.492496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968c701-001a-49fd-bde5-c9a9e496ad57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:20.494996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968c701-001a-49fd-bde5-c9a9e496ad57 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:20.504077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 735/1468] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:22.772895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89875d1-d336-4ee0-9c23-fbe24d0c9dc9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:22.773480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89875d1-d336-4ee0-9c23-fbe24d0c9dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:22.773480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89875d1-d336-4ee0-9c23-fbe24d0c9dc9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:22.775835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 734/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:22.781252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48226-3059-47bf-af70-d3c33e78fc9a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:22.781666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48226-3059-47bf-af70-d3c33e78fc9a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:22.781828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48226-3059-47bf-af70-d3c33e78fc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:22.799704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9af48226-3059-47bf-af70-d3c33e78fc9a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:22.800883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9af48226-3059-47bf-af70-d3c33e78fc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:22.809134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 736/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:22.846711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89875d1-d336-4ee0-9c23-fbe24d0c9dc9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:22.857804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89875d1-d336-4ee0-9c23-fbe24d0c9dc9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:22.861301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dc3c2-2871-4a1b-9bd5-d9b772a696b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:22.861914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc3c2-2871-4a1b-9bd5-d9b772a696b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:22.862192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc3c2-2871-4a1b-9bd5-d9b772a696b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:22.862464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dc3c2-2871-4a1b-9bd5-d9b772a696b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:22.871854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dc3c2-2871-4a1b-9bd5-d9b772a696b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:22.873280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dc3c2-2871-4a1b-9bd5-d9b772a696b1 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:22.882359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 735/1471] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:39:25.130366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3e03-344b-4b56-86d6-6e68370cf715 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:25.130931 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3e03-344b-4b56-86d6-6e68370cf715 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:25.130931 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de3e03-344b-4b56-86d6-6e68370cf715 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:25.132737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 737/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:25.138165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c86f-ce44-4d83-aae9-8d4238c4ce43 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:25.138571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c86f-ce44-4d83-aae9-8d4238c4ce43 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:25.138720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c86f-ce44-4d83-aae9-8d4238c4ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:25.157256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ed32c86f-ce44-4d83-aae9-8d4238c4ce43 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:25.158445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ed32c86f-ce44-4d83-aae9-8d4238c4ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:25.166689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 736/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:25.204195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3e03-344b-4b56-86d6-6e68370cf715 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:25.215584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de3e03-344b-4b56-86d6-6e68370cf715 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:25.219288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662125-72ea-4f96-b6db-fc6241324f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:25.219921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662125-72ea-4f96-b6db-fc6241324f7c service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:25.220195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662125-72ea-4f96-b6db-fc6241324f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:25.220493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662125-72ea-4f96-b6db-fc6241324f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:25.230010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662125-72ea-4f96-b6db-fc6241324f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:25.231464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662125-72ea-4f96-b6db-fc6241324f7c service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:25.240563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 738/1474] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:27.481307 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2dcb-bd4c-41e9-b798-f73959e0f3e2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:27.481868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2dcb-bd4c-41e9-b798-f73959e0f3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:27.481868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2dcb-bd4c-41e9-b798-f73959e0f3e2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:27.483651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 737/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:27.489214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eed84-c2f8-47c6-9be6-2c741fdb3e53 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:27.489635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eed84-c2f8-47c6-9be6-2c741fdb3e53 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:27.489749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eed84-c2f8-47c6-9be6-2c741fdb3e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:27.507872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-545eed84-c2f8-47c6-9be6-2c741fdb3e53 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:27.513408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-545eed84-c2f8-47c6-9be6-2c741fdb3e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:27.516883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 739/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:27.554717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2dcb-bd4c-41e9-b798-f73959e0f3e2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:27.565454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2dcb-bd4c-41e9-b798-f73959e0f3e2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:27.569273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dbc1d-7498-4070-a4bd-9f9cceb0263b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:27.569921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dbc1d-7498-4070-a4bd-9f9cceb0263b service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:27.570200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dbc1d-7498-4070-a4bd-9f9cceb0263b service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:27.570508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dbc1d-7498-4070-a4bd-9f9cceb0263b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:27.579801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dbc1d-7498-4070-a4bd-9f9cceb0263b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:27.581309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dbc1d-7498-4070-a4bd-9f9cceb0263b service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:27.591293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 738/1477] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:29.820403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad308-1643-477b-be7f-2890235bee9a None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:29.821221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad308-1643-477b-be7f-2890235bee9a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:29.821221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ad308-1643-477b-be7f-2890235bee9a None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:29.823162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 740/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:29.828800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec64a2-5420-4442-af5e-bc86ecf19e22 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:29.829209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec64a2-5420-4442-af5e-bc86ecf19e22 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:29.829346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec64a2-5420-4442-af5e-bc86ecf19e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:29.847220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-81ec64a2-5420-4442-af5e-bc86ecf19e22 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:29.848401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-81ec64a2-5420-4442-af5e-bc86ecf19e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:29.856739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 739/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:39:29.893013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ad308-1643-477b-be7f-2890235bee9a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:29.894739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f87ad308-1643-477b-be7f-2890235bee9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:29.908171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ad308-1643-477b-be7f-2890235bee9a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:29.911695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6680ebc-6530-4a21-8797-ee760afc82f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:29.912314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680ebc-6530-4a21-8797-ee760afc82f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:29.912586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680ebc-6530-4a21-8797-ee760afc82f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:29.912852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6680ebc-6530-4a21-8797-ee760afc82f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:29.922494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6680ebc-6530-4a21-8797-ee760afc82f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:29.923953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6680ebc-6530-4a21-8797-ee760afc82f8 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:29.933157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 741/1480] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:32.181890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2525d1-20b8-45e9-8b40-cfc791607f44 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:32.182422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2525d1-20b8-45e9-8b40-cfc791607f44 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:32.182422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2525d1-20b8-45e9-8b40-cfc791607f44 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:32.184159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 740/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:32.189650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a35eb6-f6f9-4a00-8bc6-651ac7817085 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:32.190070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a35eb6-f6f9-4a00-8bc6-651ac7817085 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:32.190210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a35eb6-f6f9-4a00-8bc6-651ac7817085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:32.208503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-66a35eb6-f6f9-4a00-8bc6-651ac7817085 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:32.209687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-66a35eb6-f6f9-4a00-8bc6-651ac7817085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:32.217607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 742/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:32.254385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2525d1-20b8-45e9-8b40-cfc791607f44 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:32.265995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2525d1-20b8-45e9-8b40-cfc791607f44 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:32.269517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e5ca7-a9b1-410e-85b3-b17f7e9d42cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:32.270128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e5ca7-a9b1-410e-85b3-b17f7e9d42cf service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:32.270409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e5ca7-a9b1-410e-85b3-b17f7e9d42cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:32.270681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e5ca7-a9b1-410e-85b3-b17f7e9d42cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:32.279583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e5ca7-a9b1-410e-85b3-b17f7e9d42cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:32.281011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e5ca7-a9b1-410e-85b3-b17f7e9d42cf service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:32.290063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 741/1483] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:49.408952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207e6a-4a04-4126-81a0-2c75249dcfee None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:49.409536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207e6a-4a04-4126-81a0-2c75249dcfee None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:49.409536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207e6a-4a04-4126-81a0-2c75249dcfee None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:49.411256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 743/1484] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:49.417323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee0c9-2ca3-430d-9947-ffd27683636f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:49.417772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee0c9-2ca3-430d-9947-ffd27683636f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:49.417879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee0c9-2ca3-430d-9947-ffd27683636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:49.435454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d1bee0c9-2ca3-430d-9947-ffd27683636f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:49.436660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d1bee0c9-2ca3-430d-9947-ffd27683636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:49.444460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 742/1485] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:49.491026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1408d-6e1c-4658-8178-52c0feaf5ad5 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:49.491311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1408d-6e1c-4658-8178-52c0feaf5ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:49.491580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1408d-6e1c-4658-8178-52c0feaf5ad5 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:49.493330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 744/1486] 10.222.0.21 () {54 vars in 962 bytes} [Mon Jan 31 04:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:49.498136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff6987-5702-4d98-be57-a5c2aa6ccef8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:49.498428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff6987-5702-4d98-be57-a5c2aa6ccef8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:49.498707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff6987-5702-4d98-be57-a5c2aa6ccef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:49.516918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-06ff6987-5702-4d98-be57-a5c2aa6ccef8 None None] MFA Rules not processed for user `72317f5c187c41e9b2d1c53c9cedcd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:49.518102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-06ff6987-5702-4d98-be57-a5c2aa6ccef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:49.525116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 743/1487] 10.222.0.21 () {58 vars in 1059 bytes} [Mon Jan 31 04:39:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:49.532193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1408d-6e1c-4658-8178-52c0feaf5ad5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:49.543285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1408d-6e1c-4658-8178-52c0feaf5ad5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:49.546727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702c2f8-c55a-4a9a-b569-34ced3feab1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72317f5c187c41e9b2d1c53c9cedcd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:49.547360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c2f8-c55a-4a9a-b569-34ced3feab1b service glance] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:49.547640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c2f8-c55a-4a9a-b569-34ced3feab1b service glance] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:49.547906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c2f8-c55a-4a9a-b569-34ced3feab1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:49.556949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c2f8-c55a-4a9a-b569-34ced3feab1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:49.558416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c2f8-c55a-4a9a-b569-34ced3feab1b service glance] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:49.567680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 745/1488] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:39:51.842375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d562be-5103-4f1d-ba72-fc4cd412bc5e None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:51.842982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d562be-5103-4f1d-ba72-fc4cd412bc5e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:51.842982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d562be-5103-4f1d-ba72-fc4cd412bc5e None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:51.844679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 744/1489] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:51.849818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65bd62-e9f9-4c40-a1dc-661d801da3bd None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:51.850244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65bd62-e9f9-4c40-a1dc-661d801da3bd None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:51.850372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65bd62-e9f9-4c40-a1dc-661d801da3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:51.868920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ec65bd62-e9f9-4c40-a1dc-661d801da3bd None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:51.870109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ec65bd62-e9f9-4c40-a1dc-661d801da3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:51.877779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 746/1490] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:51.901744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d562be-5103-4f1d-ba72-fc4cd412bc5e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:51.914289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d562be-5103-4f1d-ba72-fc4cd412bc5e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:51.918775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c33f5-7968-44b1-95ca-128aeb5dca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:51.919431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c33f5-7968-44b1-95ca-128aeb5dca22 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:51.919714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c33f5-7968-44b1-95ca-128aeb5dca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:51.919990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c33f5-7968-44b1-95ca-128aeb5dca22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:51.920755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c33f5-7968-44b1-95ca-128aeb5dca22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:51.922587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c33f5-7968-44b1-95ca-128aeb5dca22 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:51.936738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 745/1491] 10.222.0.21 () {56 vars in 1108 bytes} [Mon Jan 31 04:39:51 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:39:54.172303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc475-d676-45be-9fa6-013de00253e4 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:54.172811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc475-d676-45be-9fa6-013de00253e4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:54.172811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc475-d676-45be-9fa6-013de00253e4 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:54.174566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 747/1492] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:54.180663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729990e-357b-43d9-a2a9-4951f485e998 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:54.181089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729990e-357b-43d9-a2a9-4951f485e998 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:54.181200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729990e-357b-43d9-a2a9-4951f485e998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:54.198648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7729990e-357b-43d9-a2a9-4951f485e998 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:54.199845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7729990e-357b-43d9-a2a9-4951f485e998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:54.207335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 746/1493] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:54.249486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc475-d676-45be-9fa6-013de00253e4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:54.264103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc475-d676-45be-9fa6-013de00253e4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:54.269629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d439a4-55f1-46ee-962e-df5d66c100c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:54.270243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d439a4-55f1-46ee-962e-df5d66c100c4 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:54.270519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d439a4-55f1-46ee-962e-df5d66c100c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:54.270806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d439a4-55f1-46ee-962e-df5d66c100c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:54.278688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d439a4-55f1-46ee-962e-df5d66c100c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:54.280385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d439a4-55f1-46ee-962e-df5d66c100c4 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:54.289894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 748/1494] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:56.668200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf57a9a-7f5c-4b46-a984-497ba763150d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:56.668769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf57a9a-7f5c-4b46-a984-497ba763150d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:56.668769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf57a9a-7f5c-4b46-a984-497ba763150d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:56.670559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 747/1495] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:56.676064 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613966-13e6-443a-abb9-02e1d55b02b5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:56.676462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613966-13e6-443a-abb9-02e1d55b02b5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:56.676617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613966-13e6-443a-abb9-02e1d55b02b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:56.693793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-84613966-13e6-443a-abb9-02e1d55b02b5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:56.695595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-84613966-13e6-443a-abb9-02e1d55b02b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:56.703587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 749/1496] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:56.739159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf57a9a-7f5c-4b46-a984-497ba763150d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:56.749587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf57a9a-7f5c-4b46-a984-497ba763150d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:56.753149 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7ee21-de50-4c71-b356-a38b0106a4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:56.753770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ee21-de50-4c71-b356-a38b0106a4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:56.754056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ee21-de50-4c71-b356-a38b0106a4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:56.754329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7ee21-de50-4c71-b356-a38b0106a4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:56.763946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7ee21-de50-4c71-b356-a38b0106a4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:56.765644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7ee21-de50-4c71-b356-a38b0106a4b3 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:56.775641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 748/1497] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:39:59.094085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4919a-4930-404c-baf5-106fb9b79853 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:59.094618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4919a-4930-404c-baf5-106fb9b79853 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:59.094618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4919a-4930-404c-baf5-106fb9b79853 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:59.096488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 750/1498] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:39:59.102773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bddace-34d2-4b51-bf73-05d4cdf346af None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:59.103206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bddace-34d2-4b51-bf73-05d4cdf346af None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:59.103350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bddace-34d2-4b51-bf73-05d4cdf346af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:59.121126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-92bddace-34d2-4b51-bf73-05d4cdf346af None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:39:59.122312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-92bddace-34d2-4b51-bf73-05d4cdf346af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:39:59.130035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 749/1499] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:39:59.170221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4919a-4930-404c-baf5-106fb9b79853 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:39:59.180868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4919a-4930-404c-baf5-106fb9b79853 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:39:59.184442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a29a0-fbe3-4dbb-a5ca-a9481afae411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:39:59.185060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a29a0-fbe3-4dbb-a5ca-a9481afae411 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:39:59.185340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a29a0-fbe3-4dbb-a5ca-a9481afae411 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:39:59.185612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a29a0-fbe3-4dbb-a5ca-a9481afae411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:39:59.194416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a29a0-fbe3-4dbb-a5ca-a9481afae411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:39:59.195883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a29a0-fbe3-4dbb-a5ca-a9481afae411 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:39:59.205049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 751/1500] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:40:01.580323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b6452-5f62-4079-91cf-9eb0d72e7bb9 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:01.580858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b6452-5f62-4079-91cf-9eb0d72e7bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:01.580858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b6452-5f62-4079-91cf-9eb0d72e7bb9 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:01.582661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 750/1501] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:40:01.588151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d294-3a7b-400c-8e42-cb66b408e568 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:01.588593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d294-3a7b-400c-8e42-cb66b408e568 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:01.588704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d294-3a7b-400c-8e42-cb66b408e568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:01.607525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-5ee5d294-3a7b-400c-8e42-cb66b408e568 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:40:01.608710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5ee5d294-3a7b-400c-8e42-cb66b408e568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:40:01.617015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 752/1502] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:40:01.652059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b6452-5f62-4079-91cf-9eb0d72e7bb9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:40:01.664615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b6452-5f62-4079-91cf-9eb0d72e7bb9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:40:01.668981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497436dd-6164-49f6-bbd0-304beb06fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:40:01.669795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497436dd-6164-49f6-bbd0-304beb06fd86 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:01.670068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497436dd-6164-49f6-bbd0-304beb06fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:01.670332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497436dd-6164-49f6-bbd0-304beb06fd86 admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:01.671484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497436dd-6164-49f6-bbd0-304beb06fd86 admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:40:01.673252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497436dd-6164-49f6-bbd0-304beb06fd86 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:40:01.674887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 751/1503] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:40:01 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:40:01.686680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d294-3a7b-400c-8e42-cb66b408e568 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:40:01.695818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d294-3a7b-400c-8e42-cb66b408e568 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:40:01.699359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b47d6-e016-4fc8-b693-775274d68b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:40:01.699977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b47d6-e016-4fc8-b693-775274d68b14 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:01.700256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b47d6-e016-4fc8-b693-775274d68b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:01.700526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b47d6-e016-4fc8-b693-775274d68b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:01.709083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b47d6-e016-4fc8-b693-775274d68b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:40:01.710719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b47d6-e016-4fc8-b693-775274d68b14 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:40:01.719868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 753/1504] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:40:04.286112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd06d3-e42b-4b5a-b856-15550e964fbf None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:04.286671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd06d3-e42b-4b5a-b856-15550e964fbf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:04.286671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd06d3-e42b-4b5a-b856-15550e964fbf None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:04.289637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 752/1505] 10.222.0.21 () {54 vars in 926 bytes} [Mon Jan 31 04:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:40:04.294811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437a07-9071-4069-9706-f9c80150b79f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:04.295265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437a07-9071-4069-9706-f9c80150b79f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:04.295374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437a07-9071-4069-9706-f9c80150b79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:04.312550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a5437a07-9071-4069-9706-f9c80150b79f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:40:04.313709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a5437a07-9071-4069-9706-f9c80150b79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:40:04.321621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 754/1506] 10.222.0.21 () {58 vars in 1023 bytes} [Mon Jan 31 04:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:40:04.355582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd06d3-e42b-4b5a-b856-15550e964fbf None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:40:04.368312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd06d3-e42b-4b5a-b856-15550e964fbf None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:40:04.372794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e77082-6fe5-4b27-952b-91a22665239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:40:04.373614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77082-6fe5-4b27-952b-91a22665239c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:04.373893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77082-6fe5-4b27-952b-91a22665239c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:04.374166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77082-6fe5-4b27-952b-91a22665239c admin admin] PATH_INFO: `/v3/projects/6434f6a5574340a59ffe3c6ae995c685` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:04.375378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e77082-6fe5-4b27-952b-91a22665239c admin admin] RBAC: Authorizing `identity:get_project(project_id=6434f6a5574340a59ffe3c6ae995c685)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:40:04.377189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e77082-6fe5-4b27-952b-91a22665239c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:40:04.378843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 753/1507] 10.222.0.21 () {56 vars in 1207 bytes} [Mon Jan 31 04:40:04 2022] GET /identity/v3/projects/6434f6a5574340a59ffe3c6ae995c685 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:40:04.390186 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437a07-9071-4069-9706-f9c80150b79f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:40:04.399980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437a07-9071-4069-9706-f9c80150b79f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:40:04.403397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e3496-d7b0-4279-b0d3-da36272dc2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:40:04.404011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e3496-d7b0-4279-b0d3-da36272dc2cc service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:40:04.404283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e3496-d7b0-4279-b0d3-da36272dc2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:40:04.404545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e3496-d7b0-4279-b0d3-da36272dc2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:40:04.413705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e3496-d7b0-4279-b0d3-da36272dc2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:40:04.415145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e3496-d7b0-4279-b0d3-da36272dc2cc service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:40:04.424146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 755/1508] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:41:55.796166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30309f0-8a4a-4096-837d-c6649f8cb4fb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:55.796775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30309f0-8a4a-4096-837d-c6649f8cb4fb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:55.796775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30309f0-8a4a-4096-837d-c6649f8cb4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:55.814712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b30309f0-8a4a-4096-837d-c6649f8cb4fb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:41:55.815908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b30309f0-8a4a-4096-837d-c6649f8cb4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:41:55.823545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 754/1509] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:41:55.831482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ca7af-f95d-4026-ab2f-45bca6d6ef98 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:55.831978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ca7af-f95d-4026-ab2f-45bca6d6ef98 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:55.832083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ca7af-f95d-4026-ab2f-45bca6d6ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:55.850218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-151ca7af-f95d-4026-ab2f-45bca6d6ef98 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:41:55.851414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-151ca7af-f95d-4026-ab2f-45bca6d6ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:41:55.859164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 756/1510] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:41:55.868228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30309f0-8a4a-4096-837d-c6649f8cb4fb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:55.877691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30309f0-8a4a-4096-837d-c6649f8cb4fb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:55.882223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:55.882887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:55.883173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:55.883475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:55.884210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:41:55.884516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:55.886104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:55.897815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 755/1511] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:41:55.905783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ca7af-f95d-4026-ab2f-45bca6d6ef98 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:55.915636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ca7af-f95d-4026-ab2f-45bca6d6ef98 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:55.920142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:55.920777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:55.921054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:55.921325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:55.922028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:55.923957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:56.003806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 757/1512] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:41:55 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:41:56.008175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:56.017988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79969-638a-4b5b-a135-cfe3aa11e9b0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:56.070986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:56.071566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.071847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.072121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.072821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:56.074725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:56.153892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 756/1513] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:41:56 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:41:56.158005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:56.168829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e655e-8ffd-49a2-afd3-14164ed5d3f5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:56.173256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:56.173894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.174168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.174432 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.175182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:56.180968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:56.189101 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 758/1514] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:41:56.193031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:56.203030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ef4ce-8a8e-4d7a-bb22-a32b8d9a049a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:56.207561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6433128-eed3-4264-a798-cefa69201d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:56.208229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433128-eed3-4264-a798-cefa69201d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.209003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433128-eed3-4264-a798-cefa69201d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.209285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433128-eed3-4264-a798-cefa69201d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.210017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6433128-eed3-4264-a798-cefa69201d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:56.211623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6433128-eed3-4264-a798-cefa69201d8c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:56.225492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 757/1515] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:41:56.229409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:56.238924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb13269-6906-4adc-8ece-07b982fbe108 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:56.243898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:56.244753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.245032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.245308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] PATH_INFO: `/v3/projects/3a8b6f1719f54bb6b24ba37c5c6bd7e4/users/2aed3e89f985489c86c8eb2e6456f590/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.259974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8b6f1719f54bb6b24ba37c5c6bd7e4, user_id=2aed3e89f985489c86c8eb2e6456f590, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:56.262921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:56.353841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 759/1516] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:41:56 2022] PUT /identity/v3/projects/3a8b6f1719f54bb6b24ba37c5c6bd7e4/users/2aed3e89f985489c86c8eb2e6456f590/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:41:56.366748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78bc6-5370-4fd7-8212-ab8bbc1faa64 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.367120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78bc6-5370-4fd7-8212-ab8bbc1faa64 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.367396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee78bc6-5370-4fd7-8212-ab8bbc1faa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.393108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0ee78bc6-5370-4fd7-8212-ab8bbc1faa64 None None] MFA Rules not processed for user `2aed3e89f985489c86c8eb2e6456f590`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:41:56.394291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0ee78bc6-5370-4fd7-8212-ab8bbc1faa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:41:56.455908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 758/1517] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:41:56.466872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:56.534073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c49dc0-7de7-47a2-9cbb-1b070b47c9c9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:56.540244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:56.540872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.541155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.541430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.548946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:56.550525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:56.559857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 760/1518] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:41:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:41:56.627255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553e43-7231-4a7e-ad89-44d63e4bf74b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.627555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553e43-7231-4a7e-ad89-44d63e4bf74b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.627832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2553e43-7231-4a7e-ad89-44d63e4bf74b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.629561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 759/1519] 10.222.0.21 () {52 vars in 829 bytes} [Mon Jan 31 04:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:41:56.633119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:56.692044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb51a-bdb8-431b-bdf0-8749257c2fab service nova] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:56.697144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:56.697984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:56.698259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:56.698528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] PATH_INFO: `/v3/users/2aed3e89f985489c86c8eb2e6456f590` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:56.699735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aed3e89f985489c86c8eb2e6456f590)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:56.700750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:41:56.700750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:41:56.700750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:41:56.701930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:56.867902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aed3e89f985489c86c8eb2e6456f590'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:56.868579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aed3e89f985489c86c8eb2e6456f590'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:56.888399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aed3e89f985489c86c8eb2e6456f590'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:56.900284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aed3e89f985489c86c8eb2e6456f590'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:56.993631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aed3e89f985489c86c8eb2e6456f590'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:57.000191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 761/1520] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:41:56 2022] DELETE /identity/v3/users/2aed3e89f985489c86c8eb2e6456f590 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:41:57.004660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:57.005115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:57.005230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:57.025684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:41:57.026896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:41:57.083458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 760/1521] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:41:57.094265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:57.095674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:41:57.153769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53e96-d840-4717-9943-e25bc5a1c725 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:57.157284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f3a2-6a8a-4ddb-9007-448870abc56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:57.157920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f3a2-6a8a-4ddb-9007-448870abc56c service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:57.158198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f3a2-6a8a-4ddb-9007-448870abc56c service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:57.158472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f3a2-6a8a-4ddb-9007-448870abc56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:57.167406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f3a2-6a8a-4ddb-9007-448870abc56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:57.169137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f3a2-6a8a-4ddb-9007-448870abc56c service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:57.178717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 762/1522] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:41:57.622820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:41:57.623750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:41:57.636450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f1f4a-0f3e-49aa-a53c-cd2b69032386 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:41:57.641339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:41:57.642188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:41:57.642499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:41:57.642822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] PATH_INFO: `/v3/projects/3a8b6f1719f54bb6b24ba37c5c6bd7e4` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:41:57.644018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8b6f1719f54bb6b24ba37c5c6bd7e4)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:41:57.645057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:41:57.645057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:41:57.645057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:41:57.646762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:41:57.779620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8b6f1719f54bb6b24ba37c5c6bd7e4', 'request_id': 'req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:57.861897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8b6f1719f54bb6b24ba37c5c6bd7e4', 'request_id': 'req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:57.875425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8b6f1719f54bb6b24ba37c5c6bd7e4', 'request_id': 'req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:57.886944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] The token cache is being invalidate because project 3a8b6f1719f54bb6b24ba37c5c6bd7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:41:57.887241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:57.887970 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20ac2a79-49fd-40af-abf2-83a6a1aa5f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:41:57.889576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 761/1523] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:41:57 2022] DELETE /identity/v3/projects/3a8b6f1719f54bb6b24ba37c5c6bd7e4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:43:27.687685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0641-eaea-45f9-9e7b-39ff682eb36e None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:27.688273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0641-eaea-45f9-9e7b-39ff682eb36e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:27.688273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a0641-eaea-45f9-9e7b-39ff682eb36e None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:27.690056 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 763/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:27.694840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8044ac-21dd-431a-8181-0fab14a1a286 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:27.695385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8044ac-21dd-431a-8181-0fab14a1a286 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:27.695385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8044ac-21dd-431a-8181-0fab14a1a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:27.713653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8c8044ac-21dd-431a-8181-0fab14a1a286 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:27.714884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8c8044ac-21dd-431a-8181-0fab14a1a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:27.770572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 762/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:27.924325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0641-eaea-45f9-9e7b-39ff682eb36e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:27.926013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-254a0641-eaea-45f9-9e7b-39ff682eb36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:27.997553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a0641-eaea-45f9-9e7b-39ff682eb36e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:28.003402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cd1e1-c4bb-4e5e-bd70-1d9a5c72f862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:28.004023 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cd1e1-c4bb-4e5e-bd70-1d9a5c72f862 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:28.004299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cd1e1-c4bb-4e5e-bd70-1d9a5c72f862 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:28.004569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cd1e1-c4bb-4e5e-bd70-1d9a5c72f862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:28.012766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cd1e1-c4bb-4e5e-bd70-1d9a5c72f862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:28.014344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cd1e1-c4bb-4e5e-bd70-1d9a5c72f862 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:28.024627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 764/1526] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:28.242911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2c47-8fe1-4350-97e4-75522a85736f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:28.243204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2c47-8fe1-4350-97e4-75522a85736f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:28.243499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2c47-8fe1-4350-97e4-75522a85736f None None] PATH_INFO: `/v3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:28.244921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 763/1527] 10.222.0.31 () {54 vars in 925 bytes} [Mon Jan 31 04:43:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:43:28.251363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4777d-a2e2-42de-859c-1347c3bb815d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:28.251654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4777d-a2e2-42de-859c-1347c3bb815d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:28.251933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4777d-a2e2-42de-859c-1347c3bb815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:28.270369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-24a4777d-a2e2-42de-859c-1347c3bb815d None None] MFA Rules not processed for user `266e2e8a599a4348aa356c18e3d7f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:28.271595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-24a4777d-a2e2-42de-859c-1347c3bb815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:28.332637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 765/1528] 10.222.0.31 () {58 vars in 1015 bytes} [Mon Jan 31 04:43:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:29.308212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979d42-ed3a-47aa-80a2-5aa5193c0a64 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:29.308763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979d42-ed3a-47aa-80a2-5aa5193c0a64 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:29.308763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979d42-ed3a-47aa-80a2-5aa5193c0a64 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:29.310537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 764/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:29.316144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de337225-79de-43ef-93fe-06504b5abbd1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:29.316590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de337225-79de-43ef-93fe-06504b5abbd1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:29.316688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de337225-79de-43ef-93fe-06504b5abbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:29.335521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-de337225-79de-43ef-93fe-06504b5abbd1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:29.336945 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-de337225-79de-43ef-93fe-06504b5abbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:29.344910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 766/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:29.498198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979d42-ed3a-47aa-80a2-5aa5193c0a64 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:29.513374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979d42-ed3a-47aa-80a2-5aa5193c0a64 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:29.519392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706d536-347c-43e5-b2ef-a84663dcc695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:29.520015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706d536-347c-43e5-b2ef-a84663dcc695 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:29.520296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706d536-347c-43e5-b2ef-a84663dcc695 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:29.520570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706d536-347c-43e5-b2ef-a84663dcc695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:29.528599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706d536-347c-43e5-b2ef-a84663dcc695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:29.530194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706d536-347c-43e5-b2ef-a84663dcc695 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:29.539387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 765/1531] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:38.186990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650ecb-b2f0-4bc7-9dda-25fe2518b26f None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:38.187526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650ecb-b2f0-4bc7-9dda-25fe2518b26f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:38.187526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650ecb-b2f0-4bc7-9dda-25fe2518b26f None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:38.189222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 767/1532] 10.222.0.21 () {54 vars in 960 bytes} [Mon Jan 31 04:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:38.194881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c30a7-3bfd-48a4-97d1-73104b4ec422 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:38.195317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c30a7-3bfd-48a4-97d1-73104b4ec422 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:38.195434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c30a7-3bfd-48a4-97d1-73104b4ec422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:38.213008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d87c30a7-3bfd-48a4-97d1-73104b4ec422 None None] MFA Rules not processed for user `266e2e8a599a4348aa356c18e3d7f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:38.214199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d87c30a7-3bfd-48a4-97d1-73104b4ec422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:38.222433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 766/1533] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Jan 31 04:43:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:38.229734 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93650ecb-b2f0-4bc7-9dda-25fe2518b26f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:38.243527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93650ecb-b2f0-4bc7-9dda-25fe2518b26f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:38.248412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4d475-07e8-477c-ab4f-6db69c6e9fb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:38.249024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d475-07e8-477c-ab4f-6db69c6e9fb1 service placement] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:38.249304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d475-07e8-477c-ab4f-6db69c6e9fb1 service placement] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:38.249576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d475-07e8-477c-ab4f-6db69c6e9fb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:38.258311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4d475-07e8-477c-ab4f-6db69c6e9fb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:38.260168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4d475-07e8-477c-ab4f-6db69c6e9fb1 service placement] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:38.269496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 768/1534] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:41.273064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81222104-10d3-42c4-b591-46a7923bb112 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:41.273616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81222104-10d3-42c4-b591-46a7923bb112 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:41.273616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81222104-10d3-42c4-b591-46a7923bb112 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:41.275424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 767/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:41.280333 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa65dc-9c0d-44c0-94c8-98e5438d390b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:41.280771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa65dc-9c0d-44c0-94c8-98e5438d390b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:41.280868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa65dc-9c0d-44c0-94c8-98e5438d390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:41.299292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-48aa65dc-9c0d-44c0-94c8-98e5438d390b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:41.300537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-48aa65dc-9c0d-44c0-94c8-98e5438d390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:41.308404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 769/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:41.466056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81222104-10d3-42c4-b591-46a7923bb112 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:41.480076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81222104-10d3-42c4-b591-46a7923bb112 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:41.485390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b22459-d99e-453c-a77a-39424922fab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:41.486004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22459-d99e-453c-a77a-39424922fab8 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:41.486283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22459-d99e-453c-a77a-39424922fab8 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:41.486555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22459-d99e-453c-a77a-39424922fab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:41.494377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b22459-d99e-453c-a77a-39424922fab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:41.495987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b22459-d99e-453c-a77a-39424922fab8 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:41.505618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 768/1537] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:42.779410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278027c4-94c0-4a88-ac47-7fe65ccfaedb None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:42.779988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278027c4-94c0-4a88-ac47-7fe65ccfaedb None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:42.779988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278027c4-94c0-4a88-ac47-7fe65ccfaedb None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:42.781689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 770/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 31 04:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:42.787262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1986a7-c179-403c-8549-408beed9f615 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:42.787724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1986a7-c179-403c-8549-408beed9f615 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:42.792772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1986a7-c179-403c-8549-408beed9f615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:42.806502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1f1986a7-c179-403c-8549-408beed9f615 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:42.807729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1f1986a7-c179-403c-8549-408beed9f615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:42.815677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 769/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 31 04:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:42.969621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278027c4-94c0-4a88-ac47-7fe65ccfaedb None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:42.984847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278027c4-94c0-4a88-ac47-7fe65ccfaedb None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:42.991066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b829c-6a09-4a30-800d-23ba19785ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:42.991699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b829c-6a09-4a30-800d-23ba19785ac5 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:42.991968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b829c-6a09-4a30-800d-23ba19785ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:42.992243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b829c-6a09-4a30-800d-23ba19785ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:43.000322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b829c-6a09-4a30-800d-23ba19785ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:43.001895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b829c-6a09-4a30-800d-23ba19785ac5 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:43.011532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 771/1540] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:46.995610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e7f1-f1bb-4b53-8fe6-2fe0d9d84b64 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:46.996262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e7f1-f1bb-4b53-8fe6-2fe0d9d84b64 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:46.996262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92e7f1-f1bb-4b53-8fe6-2fe0d9d84b64 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:46.997929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 770/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:47.003686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2c3f6-2ebb-403a-a81a-93eb4990461a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:47.004138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2c3f6-2ebb-403a-a81a-93eb4990461a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:47.004332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2c3f6-2ebb-403a-a81a-93eb4990461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:47.022289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-32e2c3f6-2ebb-403a-a81a-93eb4990461a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:47.023514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-32e2c3f6-2ebb-403a-a81a-93eb4990461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:47.031306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 772/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:47.068042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92e7f1-f1bb-4b53-8fe6-2fe0d9d84b64 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:47.069695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ee92e7f1-f1bb-4b53-8fe6-2fe0d9d84b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:47.123835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92e7f1-f1bb-4b53-8fe6-2fe0d9d84b64 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:47.127319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb9cd3-8db5-4400-907f-543196c6161a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:47.128569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb9cd3-8db5-4400-907f-543196c6161a service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:47.128849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb9cd3-8db5-4400-907f-543196c6161a service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:47.129120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb9cd3-8db5-4400-907f-543196c6161a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:47.137970 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb9cd3-8db5-4400-907f-543196c6161a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:47.139448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb9cd3-8db5-4400-907f-543196c6161a service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:47.148706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 771/1543] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:49.358114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b9d5-b11f-4600-8d8d-50a6df104150 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:49.358658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b9d5-b11f-4600-8d8d-50a6df104150 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:49.358658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b9d5-b11f-4600-8d8d-50a6df104150 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:49.360442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 773/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:49.369754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa059b8-e423-4886-920a-14f790659895 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:49.369754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa059b8-e423-4886-920a-14f790659895 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:49.369754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa059b8-e423-4886-920a-14f790659895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:49.385752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7fa059b8-e423-4886-920a-14f790659895 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:49.386950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7fa059b8-e423-4886-920a-14f790659895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:49.394741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 772/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:49.430874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b9d5-b11f-4600-8d8d-50a6df104150 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:49.442324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b9d5-b11f-4600-8d8d-50a6df104150 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:49.445921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371d376-0f3e-4d70-ac09-c93197f6e754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:49.446541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371d376-0f3e-4d70-ac09-c93197f6e754 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:49.446846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371d376-0f3e-4d70-ac09-c93197f6e754 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:49.447121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371d376-0f3e-4d70-ac09-c93197f6e754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:49.456032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371d376-0f3e-4d70-ac09-c93197f6e754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:49.457481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371d376-0f3e-4d70-ac09-c93197f6e754 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:49.466530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 774/1546] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:53.240568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840b65f-659b-4d52-bfe9-b57c2bd67adc None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:53.241102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840b65f-659b-4d52-bfe9-b57c2bd67adc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:53.241102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840b65f-659b-4d52-bfe9-b57c2bd67adc None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:53.242906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 773/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:43:53.248109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e001f6f-ea18-4cf3-bbd6-fe747c237235 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:53.248667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e001f6f-ea18-4cf3-bbd6-fe747c237235 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:53.248776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e001f6f-ea18-4cf3-bbd6-fe747c237235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:53.267440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9e001f6f-ea18-4cf3-bbd6-fe747c237235 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:53.269351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9e001f6f-ea18-4cf3-bbd6-fe747c237235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:53.277147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 775/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:53.543762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840b65f-659b-4d52-bfe9-b57c2bd67adc None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:53.545432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c840b65f-659b-4d52-bfe9-b57c2bd67adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:53.603081 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840b65f-659b-4d52-bfe9-b57c2bd67adc None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:53.606600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada4d05-6797-49c4-be3b-fac0ea363d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:53.607262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4d05-6797-49c4-be3b-fac0ea363d66 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:53.608137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4d05-6797-49c4-be3b-fac0ea363d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:53.608137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada4d05-6797-49c4-be3b-fac0ea363d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:53.616939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada4d05-6797-49c4-be3b-fac0ea363d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:53.618413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada4d05-6797-49c4-be3b-fac0ea363d66 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:53.628428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 774/1549] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:43:55.886969 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5227-9659-47d5-b145-9696dea47d34 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:55.887553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5227-9659-47d5-b145-9696dea47d34 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:55.887553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df5227-9659-47d5-b145-9696dea47d34 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:55.889281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 776/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 31 04:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:55.895088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbb3a4-37bc-4986-aec1-e05a69bda88b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:55.895519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbb3a4-37bc-4986-aec1-e05a69bda88b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:55.895624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbb3a4-37bc-4986-aec1-e05a69bda88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:55.915385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-09fbb3a4-37bc-4986-aec1-e05a69bda88b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:55.916567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-09fbb3a4-37bc-4986-aec1-e05a69bda88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:55.924151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 775/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 31 04:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:43:56.173837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f23dfe-1aee-49ba-8426-c4046bd7dff2 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:56.174042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f23dfe-1aee-49ba-8426-c4046bd7dff2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:56.174317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f23dfe-1aee-49ba-8426-c4046bd7dff2 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:56.176155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 777/1552] 10.222.0.21 () {54 vars in 963 bytes} [Mon Jan 31 04:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:43:56.181053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5119a7-d64d-4b23-822a-25f945b5edd6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:56.181335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5119a7-d64d-4b23-822a-25f945b5edd6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:56.181604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5119a7-d64d-4b23-822a-25f945b5edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:56.199341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ef5119a7-d64d-4b23-822a-25f945b5edd6 None None] MFA Rules not processed for user `7b6b83d1d42045bdad91bf814b54a7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:43:56.200510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ef5119a7-d64d-4b23-822a-25f945b5edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:43:56.207534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 776/1553] 10.222.0.21 () {58 vars in 1060 bytes} [Mon Jan 31 04:43:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:43:56.214940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f23dfe-1aee-49ba-8426-c4046bd7dff2 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:43:56.225887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f23dfe-1aee-49ba-8426-c4046bd7dff2 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:43:56.229358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb8914-90e9-4c46-9c77-56c8dd1549e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:43:56.229971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8914-90e9-4c46-9c77-56c8dd1549e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:43:56.230251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8914-90e9-4c46-9c77-56c8dd1549e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:43:56.230525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb8914-90e9-4c46-9c77-56c8dd1549e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:43:56.239315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb8914-90e9-4c46-9c77-56c8dd1549e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:43:56.240748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb8914-90e9-4c46-9c77-56c8dd1549e1 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:43:56.249894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 778/1554] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:18.814902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861d7a-0a95-4f80-a506-a34e5d725cc3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:18.815599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861d7a-0a95-4f80-a506-a34e5d725cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:18.815599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861d7a-0a95-4f80-a506-a34e5d725cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:18.833634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e64b9-db56-4412-89d1-1766f9af28fb None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:18.834579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e64b9-db56-4412-89d1-1766f9af28fb None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:18.835042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e64b9-db56-4412-89d1-1766f9af28fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:18.847850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3d861d7a-0a95-4f80-a506-a34e5d725cc3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:18.849063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3d861d7a-0a95-4f80-a506-a34e5d725cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:18.862740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-011e64b9-db56-4412-89d1-1766f9af28fb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:18.864440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-011e64b9-db56-4412-89d1-1766f9af28fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:18.874609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 777/1555] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:18.878403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 779/1556] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:18.887087 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8b52-900c-4d3e-91b4-19845f3b13b2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:18.887595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8b52-900c-4d3e-91b4-19845f3b13b2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:18.887736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267faf1f-033c-480f-8767-a53346c2b9aa None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:18.887940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267faf1f-033c-480f-8767-a53346c2b9aa None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:18.888214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267faf1f-033c-480f-8767-a53346c2b9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:18.888480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8b52-900c-4d3e-91b4-19845f3b13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:18.908999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-267faf1f-033c-480f-8767-a53346c2b9aa None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:18.910200 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-267faf1f-033c-480f-8767-a53346c2b9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:18.931941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9d4a8b52-900c-4d3e-91b4-19845f3b13b2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:18.932167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 780/1557] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:18.933157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9d4a8b52-900c-4d3e-91b4-19845f3b13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:18.933343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb5a7-094e-4066-bedd-5095bc3a3cfe None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:18.933587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb5a7-094e-4066-bedd-5095bc3a3cfe None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:18.934092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb5a7-094e-4066-bedd-5095bc3a3cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:18.956404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 778/1558] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:18.957087 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a8b52-900c-4d3e-91b4-19845f3b13b2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:18.963680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-953bb5a7-094e-4066-bedd-5095bc3a3cfe None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:18.964874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-953bb5a7-094e-4066-bedd-5095bc3a3cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:18.966608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a8b52-900c-4d3e-91b4-19845f3b13b2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:18.981133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 781/1559] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:18.982163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bb5a7-094e-4066-bedd-5095bc3a3cfe None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:18.985610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906aa57-b7dd-4cff-8f5d-8613b5ba2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:18.986158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906aa57-b7dd-4cff-8f5d-8613b5ba2079 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:18.986443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906aa57-b7dd-4cff-8f5d-8613b5ba2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:18.986716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906aa57-b7dd-4cff-8f5d-8613b5ba2079 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:18.987477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906aa57-b7dd-4cff-8f5d-8613b5ba2079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:18.987869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906aa57-b7dd-4cff-8f5d-8613b5ba2079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:18.989478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906aa57-b7dd-4cff-8f5d-8613b5ba2079 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:18.999265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bb5a7-094e-4066-bedd-5095bc3a3cfe None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.008090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dca6f-f334-480a-9122-7fad229622f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.008765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dca6f-f334-480a-9122-7fad229622f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.009045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dca6f-f334-480a-9122-7fad229622f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.009321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dca6f-f334-480a-9122-7fad229622f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.010060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dca6f-f334-480a-9122-7fad229622f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:19.010359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dca6f-f334-480a-9122-7fad229622f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.011989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dca6f-f334-480a-9122-7fad229622f6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.015048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 779/1560] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.016688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1cf38-deba-4afb-81fc-b0e4d756fcc8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.017137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1cf38-deba-4afb-81fc-b0e4d756fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.017603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1cf38-deba-4afb-81fc-b0e4d756fcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.035363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 782/1561] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.036957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98ee6-15f6-48ef-ac74-870976939e64 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.037245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98ee6-15f6-48ef-ac74-870976939e64 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.037519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98ee6-15f6-48ef-ac74-870976939e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.059799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-70e1cf38-deba-4afb-81fc-b0e4d756fcc8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.061325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-70e1cf38-deba-4afb-81fc-b0e4d756fcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.072803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-bcd98ee6-15f6-48ef-ac74-870976939e64 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.074323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-bcd98ee6-15f6-48ef-ac74-870976939e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.075264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 780/1562] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.076062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1cf38-deba-4afb-81fc-b0e4d756fcc8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.087800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1cf38-deba-4afb-81fc-b0e4d756fcc8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.090676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 783/1563] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.092668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483939bd-8980-4a84-92ad-cd0726745b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.093316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483939bd-8980-4a84-92ad-cd0726745b47 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.093687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483939bd-8980-4a84-92ad-cd0726745b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.093960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483939bd-8980-4a84-92ad-cd0726745b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.094660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483939bd-8980-4a84-92ad-cd0726745b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.095646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98ee6-15f6-48ef-ac74-870976939e64 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.096587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483939bd-8980-4a84-92ad-cd0726745b47 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.105599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98ee6-15f6-48ef-ac74-870976939e64 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.110855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385267c-c773-4aad-bfbb-a0ff636194b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.111501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385267c-c773-4aad-bfbb-a0ff636194b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.111782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385267c-c773-4aad-bfbb-a0ff636194b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.112052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385267c-c773-4aad-bfbb-a0ff636194b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.112753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385267c-c773-4aad-bfbb-a0ff636194b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.114643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385267c-c773-4aad-bfbb-a0ff636194b4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.216049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 781/1564] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:19.217348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91762e9-ae5a-48fd-aeb6-3c18477e67e2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.217631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91762e9-ae5a-48fd-aeb6-3c18477e67e2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.217908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91762e9-ae5a-48fd-aeb6-3c18477e67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.236499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a91762e9-ae5a-48fd-aeb6-3c18477e67e2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.237675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a91762e9-ae5a-48fd-aeb6-3c18477e67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.282901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 784/1565] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/projects => generated 391 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:19.287238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac049aa-01de-49e1-abe3-9cfa4ece557f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.287521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac049aa-01de-49e1-abe3-9cfa4ece557f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.287792 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac049aa-01de-49e1-abe3-9cfa4ece557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.294239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 782/1566] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.295370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91762e9-ae5a-48fd-aeb6-3c18477e67e2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.305315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91762e9-ae5a-48fd-aeb6-3c18477e67e2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.308273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-aac049aa-01de-49e1-abe3-9cfa4ece557f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.308273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-aac049aa-01de-49e1-abe3-9cfa4ece557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.362836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef7dc5-1e19-4738-bd20-3bd442899106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.363416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef7dc5-1e19-4738-bd20-3bd442899106 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.363769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef7dc5-1e19-4738-bd20-3bd442899106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.363977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef7dc5-1e19-4738-bd20-3bd442899106 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.364707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef7dc5-1e19-4738-bd20-3bd442899106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:19.365004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef7dc5-1e19-4738-bd20-3bd442899106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.366670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef7dc5-1e19-4738-bd20-3bd442899106 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.367503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 785/1567] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.368757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be345-cb28-4a55-9d59-74a8bdb2d48c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.369323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be345-cb28-4a55-9d59-74a8bdb2d48c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.369323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be345-cb28-4a55-9d59-74a8bdb2d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.378304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 783/1568] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.380552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c0ea3-67cc-4007-bbdc-6a0143b6bd24 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.381742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c0ea3-67cc-4007-bbdc-6a0143b6bd24 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.382385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c0ea3-67cc-4007-bbdc-6a0143b6bd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.387209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b33be345-cb28-4a55-9d59-74a8bdb2d48c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.388410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b33be345-cb28-4a55-9d59-74a8bdb2d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.396658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 786/1569] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.397918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099841-f894-4240-a22a-149b55ded8ca None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.398209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099841-f894-4240-a22a-149b55ded8ca None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.398486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65099841-f894-4240-a22a-149b55ded8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.401206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2b2c0ea3-67cc-4007-bbdc-6a0143b6bd24 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.402575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2b2c0ea3-67cc-4007-bbdc-6a0143b6bd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.411063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 784/1570] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.411820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c0ea3-67cc-4007-bbdc-6a0143b6bd24 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.420544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-65099841-f894-4240-a22a-149b55ded8ca None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.421180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c0ea3-67cc-4007-bbdc-6a0143b6bd24 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.422352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-65099841-f894-4240-a22a-149b55ded8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.427175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e29f2-6373-4e4b-9659-3a8c18b0c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.427817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e29f2-6373-4e4b-9659-3a8c18b0c3ce admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.428096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e29f2-6373-4e4b-9659-3a8c18b0c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.428368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e29f2-6373-4e4b-9659-3a8c18b0c3ce admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.429057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e29f2-6373-4e4b-9659-3a8c18b0c3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.430568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 787/1571] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.431044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e29f2-6373-4e4b-9659-3a8c18b0c3ce admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.431425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099841-f894-4240-a22a-149b55ded8ca None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.440878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65099841-f894-4240-a22a-149b55ded8ca None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.445520 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582a42b-7fc1-4d98-84b6-688ca328b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.446164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582a42b-7fc1-4d98-84b6-688ca328b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.446447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582a42b-7fc1-4d98-84b6-688ca328b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.446741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582a42b-7fc1-4d98-84b6-688ca328b2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.451576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582a42b-7fc1-4d98-84b6-688ca328b2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.451576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582a42b-7fc1-4d98-84b6-688ca328b2c4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.528920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 785/1572] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:19.530427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd5bf-1c8e-43a5-a9b1-c2c072671568 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.530716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd5bf-1c8e-43a5-a9b1-c2c072671568 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.531648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebd5bf-1c8e-43a5-a9b1-c2c072671568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.548953 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-25ebd5bf-1c8e-43a5-a9b1-c2c072671568 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.552375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-25ebd5bf-1c8e-43a5-a9b1-c2c072671568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.552500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 788/1573] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:19.553515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e78aef-b58b-4c75-bd57-fa8f41439ad7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.553806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e78aef-b58b-4c75-bd57-fa8f41439ad7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.554630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e78aef-b58b-4c75-bd57-fa8f41439ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.560979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 786/1574] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.561640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd5bf-1c8e-43a5-a9b1-c2c072671568 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.570808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebd5bf-1c8e-43a5-a9b1-c2c072671568 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.575490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.576121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.576397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.576668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.577358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-81e78aef-b58b-4c75-bd57-fa8f41439ad7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.577473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.579545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-81e78aef-b58b-4c75-bd57-fa8f41439ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.579947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.587381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 789/1575] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.592147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d7ac-44b9-400d-a616-583e22b55e69 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.592432 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d7ac-44b9-400d-a616-583e22b55e69 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.592707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8d7ac-44b9-400d-a616-583e22b55e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.612039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-abb8d7ac-44b9-400d-a616-583e22b55e69 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.613275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-abb8d7ac-44b9-400d-a616-583e22b55e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.620991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 790/1576] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.622157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acad68-7d8e-4261-8edc-9e8d051ab7a0 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.622443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acad68-7d8e-4261-8edc-9e8d051ab7a0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.622713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acad68-7d8e-4261-8edc-9e8d051ab7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.640267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f1acad68-7d8e-4261-8edc-9e8d051ab7a0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:19.642243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f1acad68-7d8e-4261-8edc-9e8d051ab7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:19.650113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 791/1577] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:19.650892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acad68-7d8e-4261-8edc-9e8d051ab7a0 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.659747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 787/1578] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:19.660445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acad68-7d8e-4261-8edc-9e8d051ab7a0 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.660730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.714198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.714894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.715171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.715437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.716166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:19.716464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.718053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.723232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d19bc4-6959-4bb6-944d-901a3286bea8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.727992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.728650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.728931 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.729202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.729934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.730282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 792/1579] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.731204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.731623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.741875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eacb1b-1d61-410f-9723-3f714704f5ef admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.742865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 788/1580] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:19.743653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.748640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.749280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.749564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.749994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.750885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.752477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.752821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a98b-9126-4e0f-8bc5-ae5fb415423b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.757579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.758194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.758477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.758748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.759502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:19.759805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.761366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.762485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 793/1581] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:19.763381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.773592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb7f68-cbae-4304-a398-2b051580635e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.776524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 789/1582] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.777324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.785866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.786512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.786821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.787099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.787228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee815-33b2-4f2b-b9d9-3d35c5249d8a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.787836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:19.788145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.789746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.791838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.792457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.792737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.793016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.793735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:19.794038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.795661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.801771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 794/1583] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.802568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.809689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 790/1584] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.809689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.813966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53bc09-acd2-45bb-9062-8f6af9554d6d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.818628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.818824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488a0a6-2704-4f2b-8b06-6aecff96c95e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.819421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.819713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.819994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.820718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:19.821022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.822617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.823642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.824279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.824561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.824863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.825561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.827495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.834601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 795/1585] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:19.835389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.845502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5e83e-889b-4d00-adca-db5d1d14e11c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.850310 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.851097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.851375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.851641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.852329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.854197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.904223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 791/1586] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:19.904993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.914243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c852a64-d76d-40b6-a49f-35234ca48fee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.918699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.919353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.919634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.919909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:19.920627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:19.922374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:19.932102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 792/1587] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:19.932900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.940194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 796/1588] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:19.942137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:19.943890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849117fa-dd51-4364-a503-0334e8157279 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:19.997670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:19.998332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:19.998649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:19.998956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.000209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.001745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cddae-61d8-4227-b69f-75cf61399ad0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.001891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.006740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.007413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.007694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.007968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.008668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.010562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.011693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 793/1589] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:20.016106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.025300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747018-434d-46f5-ba85-419210f01cc2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.029887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.030542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.030837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.031166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.031904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.033895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.126346 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 797/1590] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:19 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.129820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.152684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 794/1591] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.154061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.191433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b8ac3-90a1-46c4-9e83-f64a5db8cb5a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.213156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81073113-b831-4feb-81de-e7dbff671e45 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.217700 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.218346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.219124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.219413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.220115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.222019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.245095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.245820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.246094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.251337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.251337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.251337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.324392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 795/1592] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.325322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.350895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 798/1593] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.350895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.388029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c3271-0074-418f-9a39-ba61baeb80a7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.408374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973f695-6273-42c7-9372-8654177e6e5e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.412956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.413822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.414099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.414421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] PATH_INFO: `/v3/projects/0e7bc0c5115343e08f45aa0220dbcd94/users/59a57cfddc61432daaea8bd2156e3124/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.429354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7bc0c5115343e08f45aa0220dbcd94, user_id=59a57cfddc61432daaea8bd2156e3124, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.432070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.443144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.443742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.444021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.444292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.445025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.446594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.456276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 796/1594] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:20.457071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.466179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f964b6-21be-4e5c-a94a-c6f81d225b3a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.470746 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.471408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.471688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.471962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.472642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.474509 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.494322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 799/1595] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:20 2022] PUT /identity/v3/projects/0e7bc0c5115343e08f45aa0220dbcd94/users/59a57cfddc61432daaea8bd2156e3124/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:20.495162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.541556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 797/1596] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/users => generated 295 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.542604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.553557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe8cd-5c40-4eee-bf0e-dbb82b0aeac5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.558206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.558868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.559153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.559426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.560123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.561411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6b937-dcf7-413d-bf51-771e7ea20424 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.562027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.566747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.567645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.567924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.568197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] PATH_INFO: `/v3/projects/a785b6652097442291512fdd26f966ee/users/25740a911eb440c2a81d4dbcbba95c99/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.582327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a785b6652097442291512fdd26f966ee, user_id=25740a911eb440c2a81d4dbcbba95c99, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.585013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.617528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 798/1597] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/users => generated 290 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.618459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.628408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e769d-c44c-4369-9eea-b93eddf810ef admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.635324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 800/1598] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:20 2022] PUT /identity/v3/projects/a785b6652097442291512fdd26f966ee/users/25740a911eb440c2a81d4dbcbba95c99/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:20.636170 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.683618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.684277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.684558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.684832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.685519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.687551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.695544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63403f7-cd7e-44bd-83bf-cdf4235c8214 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.700191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.700839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.701117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.701387 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.702082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.704635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.791416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 799/1599] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.792250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.802115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196f387-7673-43e3-a81b-05fb503cb8fe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.806709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.807362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.807637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.807906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.808583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.810488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.820124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 801/1600] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.821071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.830557 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf19b3b-dddd-455f-90bf-d6ba4b46cb4f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.835179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.835944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.836232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.836504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.837216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.838806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.849139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 802/1601] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:20.849892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.859009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdbc6f-7569-4208-a224-d6c890094695 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.864487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3aa288-7d55-475f-8aef-58c9b1f1def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.865190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa288-7d55-475f-8aef-58c9b1f1def4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.865469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa288-7d55-475f-8aef-58c9b1f1def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.865740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3aa288-7d55-475f-8aef-58c9b1f1def4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.866426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa288-7d55-475f-8aef-58c9b1f1def4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.867968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3aa288-7d55-475f-8aef-58c9b1f1def4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.877560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 803/1602] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:20.878727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839832f1-117f-4972-a812-80e90223d20a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.879027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839832f1-117f-4972-a812-80e90223d20a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.879295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839832f1-117f-4972-a812-80e90223d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.900278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 800/1603] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:20.901295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.905814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-839832f1-117f-4972-a812-80e90223d20a None None] MFA Rules not processed for user `59a57cfddc61432daaea8bd2156e3124`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:20.907611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-839832f1-117f-4972-a812-80e90223d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:20.911347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fe536-21a7-4f5b-9d4e-de0376e5ed21 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.915977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2cbb-f76d-4433-b1d9-bb875e1d6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.916612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2cbb-f76d-4433-b1d9-bb875e1d6ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.917002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2cbb-f76d-4433-b1d9-bb875e1d6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.917278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2cbb-f76d-4433-b1d9-bb875e1d6ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.918004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2cbb-f76d-4433-b1d9-bb875e1d6ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.919622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2cbb-f76d-4433-b1d9-bb875e1d6ff7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.933607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 801/1604] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:20.934943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf038cd-bb18-42a3-a046-2dfda79ac681 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.935231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf038cd-bb18-42a3-a046-2dfda79ac681 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.935502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf038cd-bb18-42a3-a046-2dfda79ac681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.952498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-acf038cd-bb18-42a3-a046-2dfda79ac681 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:20.953675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-acf038cd-bb18-42a3-a046-2dfda79ac681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:20.961517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 802/1605] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:20.962296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf038cd-bb18-42a3-a046-2dfda79ac681 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.972372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf038cd-bb18-42a3-a046-2dfda79ac681 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.979684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 804/1606] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:20.979684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839832f1-117f-4972-a812-80e90223d20a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:20.983932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.985176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.985473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.986659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.986659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.988275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.990899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839832f1-117f-4972-a812-80e90223d20a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:20.995863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:20.996615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:20.996905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:20.997180 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:20.997921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:20.998991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 803/1607] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:20.999835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:20.999957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.009464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e5c95-a753-4ff2-9308-3c38761e19e2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.010687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 805/1608] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:21.011597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.014299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.015183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.016029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.016304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] PATH_INFO: `/v3/projects/41828fbc91c740cfbec65e04e92a4ecc/users/6a6f7f126c2a4cbe80f029f352c4cafd/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.022181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145fdad-b016-4218-b4ae-4630deb75ce1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.026872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.027510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.027789 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.028088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.028783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.030360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.030668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41828fbc91c740cfbec65e04e92a4ecc, user_id=6a6f7f126c2a4cbe80f029f352c4cafd, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.033980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.041028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 806/1609] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:21.041810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.051325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29d129-3bc3-4905-aecb-a2604e8c13f6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.055865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.056475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.056757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.057030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.057732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.059319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.071532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 807/1610] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:21.072330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.082468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1418bcd-7754-442c-921c-ec485d9158d3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.087184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.087826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.088102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.088379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.089104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.090695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.099989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 804/1611] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:20 2022] PUT /identity/v3/projects/41828fbc91c740cfbec65e04e92a4ecc/users/6a6f7f126c2a4cbe80f029f352c4cafd/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:21.100889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.105049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 808/1612] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:21.105049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.116971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d58ee0-f919-4788-9922-bdec857915fa admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.160602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae538ca-fe44-4c0e-9f8b-d833a79da328 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.164867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.165513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.165797 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.166068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.178149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c884eb-8064-4b01-845a-e9da22880732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.179215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c884eb-8064-4b01-845a-e9da22880732 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.179682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c884eb-8064-4b01-845a-e9da22880732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.180127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c884eb-8064-4b01-845a-e9da22880732 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.181148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c884eb-8064-4b01-845a-e9da22880732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.182763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c884eb-8064-4b01-845a-e9da22880732 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.192958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 809/1613] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:21.194938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef96a-1d85-447d-8e13-7a81896b49f5 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.194938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef96a-1d85-447d-8e13-7a81896b49f5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.194938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef96a-1d85-447d-8e13-7a81896b49f5 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.196497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 810/1614] 10.222.0.21 () {54 vars in 961 bytes} [Mon Jan 31 04:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:45:21.197200 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ef96a-1d85-447d-8e13-7a81896b49f5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.212745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ef96a-1d85-447d-8e13-7a81896b49f5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.217887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.219487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.219772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.220192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.221363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.223459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.234692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 811/1615] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:21.236255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.240863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.243940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.245790 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3d8e-686e-4b93-a612-e2b14bdbc0ed admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.250868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.253724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.253724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.253724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] PATH_INFO: `/v3/projects/3951fb700ad04745afa04a4b077da951/users/aa68ebb7220c4e6383128947fc970877/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.255202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 805/1616] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:21.256424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.265853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6d214-398e-4525-a6e5-7963091eea68 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.270569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3951fb700ad04745afa04a4b077da951, user_id=aa68ebb7220c4e6383128947fc970877, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.271385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b480a2-3711-436c-acb2-4c498127265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.272122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b480a2-3711-436c-acb2-4c498127265f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.272541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b480a2-3711-436c-acb2-4c498127265f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.272885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b480a2-3711-436c-acb2-4c498127265f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.273355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.273798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b480a2-3711-436c-acb2-4c498127265f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.275593 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b480a2-3711-436c-acb2-4c498127265f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.290619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 806/1617] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:21.290619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4620f4a-1e87-4caf-9e19-4b943db47552 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.290619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4620f4a-1e87-4caf-9e19-4b943db47552 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.290619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4620f4a-1e87-4caf-9e19-4b943db47552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.308598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e4620f4a-1e87-4caf-9e19-4b943db47552 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:21.310050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e4620f4a-1e87-4caf-9e19-4b943db47552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:21.318644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 807/1618] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:21.319592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4620f4a-1e87-4caf-9e19-4b943db47552 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.329915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4620f4a-1e87-4caf-9e19-4b943db47552 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.334730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87091fd1-1832-4ada-8875-e7e2c417ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.335626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091fd1-1832-4ada-8875-e7e2c417ddfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.338423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091fd1-1832-4ada-8875-e7e2c417ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.338423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87091fd1-1832-4ada-8875-e7e2c417ddfb admin admin] PATH_INFO: `/v3/projects/3cc69e55b9254a6ba45b32be8fc0df66/users/b07cb89be4584e6b97df973c88daa6c5/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.351169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87091fd1-1832-4ada-8875-e7e2c417ddfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc69e55b9254a6ba45b32be8fc0df66, user_id=b07cb89be4584e6b97df973c88daa6c5, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.354094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87091fd1-1832-4ada-8875-e7e2c417ddfb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.363894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 812/1619] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:21 2022] PUT /identity/v3/projects/3951fb700ad04745afa04a4b077da951/users/aa68ebb7220c4e6383128947fc970877/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:21.367263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.428384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3b41-9533-4bc7-8c43-ca66504a8231 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.433255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.434135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.434414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.434735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] PATH_INFO: `/v3/projects/fb88cf656be440459fcc510c5486f886/users/9886f1f479254beea6f5b16291745c69/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.450198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 808/1620] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:21 2022] PUT /identity/v3/projects/3cc69e55b9254a6ba45b32be8fc0df66/users/b07cb89be4584e6b97df973c88daa6c5/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:21.451720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e82f-7688-4599-a9d1-c27c08a51303 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.452013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e82f-7688-4599-a9d1-c27c08a51303 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.452293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909e82f-7688-4599-a9d1-c27c08a51303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.455239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb88cf656be440459fcc510c5486f886, user_id=9886f1f479254beea6f5b16291745c69, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.458181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.477820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c909e82f-7688-4599-a9d1-c27c08a51303 None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:21.477820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c909e82f-7688-4599-a9d1-c27c08a51303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:21.524394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 813/1621] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:21 2022] PUT /identity/v3/projects/fb88cf656be440459fcc510c5486f886/users/9886f1f479254beea6f5b16291745c69/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:21.525450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.558669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 809/1622] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Jan 31 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:21.560183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e82f-7688-4599-a9d1-c27c08a51303 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.601041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56988eb-4474-47b8-82fb-c2d701f0df9d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.607424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.608369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.608645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.608939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] PATH_INFO: `/v3/projects/f7bb7271fb4d4239a0b83b74df4c14b0/users/1f4ee973a7a044a8a460caddd78566d3/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.627251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bb7271fb4d4239a0b83b74df4c14b0, user_id=1f4ee973a7a044a8a460caddd78566d3, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.629334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909e82f-7688-4599-a9d1-c27c08a51303 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.630071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.636650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf13477-5acc-4388-9d05-18b96b2548b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.638373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13477-5acc-4388-9d05-18b96b2548b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.638373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13477-5acc-4388-9d05-18b96b2548b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.638373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13477-5acc-4388-9d05-18b96b2548b0 admin admin] PATH_INFO: `/v3/projects/5d744e5fde824907b30fc07b6482bfe2/users/f8b42bceee2e4d2995aa39a46857e3cb/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.655583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf13477-5acc-4388-9d05-18b96b2548b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d744e5fde824907b30fc07b6482bfe2, user_id=f8b42bceee2e4d2995aa39a46857e3cb, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.659840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf13477-5acc-4388-9d05-18b96b2548b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.715293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 814/1623] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:21 2022] PUT /identity/v3/projects/f7bb7271fb4d4239a0b83b74df4c14b0/users/1f4ee973a7a044a8a460caddd78566d3/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:21.716249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.741842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 810/1624] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:21 2022] PUT /identity/v3/projects/5d744e5fde824907b30fc07b6482bfe2/users/f8b42bceee2e4d2995aa39a46857e3cb/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:21.744096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555652c-61c6-4663-a231-7e490db24938 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.744563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555652c-61c6-4663-a231-7e490db24938 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.745018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555652c-61c6-4663-a231-7e490db24938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.776413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8555652c-61c6-4663-a231-7e490db24938 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:21.776413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8555652c-61c6-4663-a231-7e490db24938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:21.792177 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848f4f2-228b-45a7-b568-1f48b4be32f9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.850844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 811/1625] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:21.850844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389b8ea-35a6-4dc1-bf82-9715fafdbcc2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.850844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389b8ea-35a6-4dc1-bf82-9715fafdbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.850844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389b8ea-35a6-4dc1-bf82-9715fafdbcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.853119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.853887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.854241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.854689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.865259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:21.866872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:21.870372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e389b8ea-35a6-4dc1-bf82-9715fafdbcc2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:21.871666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e389b8ea-35a6-4dc1-bf82-9715fafdbcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:21.877288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 815/1626] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:21.878115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:21.883014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 812/1627] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:21.884430 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed07e1-f2c4-4cec-abc5-e473159431a6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.884717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed07e1-f2c4-4cec-abc5-e473159431a6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.884992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed07e1-f2c4-4cec-abc5-e473159431a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.912637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-52ed07e1-f2c4-4cec-abc5-e473159431a6 None None] MFA Rules not processed for user `9886f1f479254beea6f5b16291745c69`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:21.913849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-52ed07e1-f2c4-4cec-abc5-e473159431a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:21.960312 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd64ed-c7d2-4f4e-8241-608c46bff2d0 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:21.966197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43289b54-7fd3-493b-b2f9-2a8f1636cb75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:21.966882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43289b54-7fd3-493b-b2f9-2a8f1636cb75 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.967166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43289b54-7fd3-493b-b2f9-2a8f1636cb75 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.967436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43289b54-7fd3-493b-b2f9-2a8f1636cb75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:21.981597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 813/1628] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:21.982988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:21.983214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:21.983572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.010308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] MFA Rules not processed for user `1f4ee973a7a044a8a460caddd78566d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:22.011500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:22.024909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43289b54-7fd3-493b-b2f9-2a8f1636cb75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.026623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43289b54-7fd3-493b-b2f9-2a8f1636cb75 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.036625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 816/1629] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:22.037976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31e68-f68f-4ded-bde8-1fb18965f9e7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.038262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31e68-f68f-4ded-bde8-1fb18965f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.038533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31e68-f68f-4ded-bde8-1fb18965f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.068019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-43d31e68-f68f-4ded-bde8-1fb18965f9e7 None None] MFA Rules not processed for user `f8b42bceee2e4d2995aa39a46857e3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:22.069917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-43d31e68-f68f-4ded-bde8-1fb18965f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:22.082227 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 814/1630] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:22.086243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.088467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:22.104371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48910190-6865-429c-b907-c6bb31ee9acd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.109306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.110222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.110741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.111206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.122109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.123853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.148897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 815/1631] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:22.149893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.163803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 817/1632] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:22.164469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d31e68-f68f-4ded-bde8-1fb18965f9e7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.180328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c8e6-9a3d-4915-87ca-8b365279e60b service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.185738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e936a-6885-4b13-87ac-31d1b26a020b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.186372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e936a-6885-4b13-87ac-31d1b26a020b service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.186653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e936a-6885-4b13-87ac-31d1b26a020b service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.186951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e936a-6885-4b13-87ac-31d1b26a020b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.190352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d31e68-f68f-4ded-bde8-1fb18965f9e7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.195582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1697-8a87-4a57-bf81-7555bb962670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.196285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1697-8a87-4a57-bf81-7555bb962670 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.196560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1697-8a87-4a57-bf81-7555bb962670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.196831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1697-8a87-4a57-bf81-7555bb962670 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.197635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1697-8a87-4a57-bf81-7555bb962670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.199778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1697-8a87-4a57-bf81-7555bb962670 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.205680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e936a-6885-4b13-87ac-31d1b26a020b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.207871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e936a-6885-4b13-87ac-31d1b26a020b service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.221471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 816/1633] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:22.223840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af05f-438a-4fef-9247-dfc2d89c0eca None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.224360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af05f-438a-4fef-9247-dfc2d89c0eca None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.224906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af05f-438a-4fef-9247-dfc2d89c0eca None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.227519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 817/1634] 10.222.0.21 () {54 vars in 961 bytes} [Mon Jan 31 04:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:45:22.228500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af05f-438a-4fef-9247-dfc2d89c0eca None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.306148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af05f-438a-4fef-9247-dfc2d89c0eca None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.309943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.310596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.314452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.314844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.328510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 818/1635] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:22 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:22.329932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47865bcf-133e-4497-9da7-f831d2faabea None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.330222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47865bcf-133e-4497-9da7-f831d2faabea None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.331119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47865bcf-133e-4497-9da7-f831d2faabea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.335262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.338969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.351618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-47865bcf-133e-4497-9da7-f831d2faabea None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:22.353601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-47865bcf-133e-4497-9da7-f831d2faabea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:22.364256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 818/1636] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:22.379138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.407486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f309cf-424a-4131-8f2a-5e9cdd1eeae8 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.451652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 819/1637] 10.222.0.21 () {58 vars in 1058 bytes} [Mon Jan 31 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:22.454710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413949e-b8d4-4ca1-b1a5-7c98a88047f7 None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.455606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413949e-b8d4-4ca1-b1a5-7c98a88047f7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.456054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413949e-b8d4-4ca1-b1a5-7c98a88047f7 None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.459204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 820/1638] 10.222.0.21 () {54 vars in 912 bytes} [Mon Jan 31 04:45:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:45:22.462558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413949e-b8d4-4ca1-b1a5-7c98a88047f7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.479273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413949e-b8d4-4ca1-b1a5-7c98a88047f7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.488406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf069757-bd46-42b2-84e3-7a6250e52d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.491683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf069757-bd46-42b2-84e3-7a6250e52d0c service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.491683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf069757-bd46-42b2-84e3-7a6250e52d0c service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.491683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf069757-bd46-42b2-84e3-7a6250e52d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.542168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.542940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.543262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.545759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.549404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.553187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.614348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf069757-bd46-42b2-84e3-7a6250e52d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.618141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf069757-bd46-42b2-84e3-7a6250e52d0c service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.634139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 821/1639] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:22.636521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5385-4e24-479a-a381-913784e7ae77 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.636989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5385-4e24-479a-a381-913784e7ae77 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.637821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5385-4e24-479a-a381-913784e7ae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.668245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 819/1640] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:22 2022] POST /identity/v3/users => generated 299 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:22.669256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.680764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-12eb5385-4e24-479a-a381-913784e7ae77 None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:22.684196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-12eb5385-4e24-479a-a381-913784e7ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:22.695395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f366064-487f-4cc4-bdf7-fcae714b268f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.707991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.710814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.711625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 822/1641] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:22.711800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.712260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.713016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.715264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.726485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5385-4e24-479a-a381-913784e7ae77 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.757173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 820/1642] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:22.758098 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.786048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cd5e1-be71-46b5-b31c-4df2b41f9923 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.796348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795c8dd-8647-4d07-a5f7-032a89149edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.800630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c8dd-8647-4d07-a5f7-032a89149edc admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.801571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c8dd-8647-4d07-a5f7-032a89149edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.807017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795c8dd-8647-4d07-a5f7-032a89149edc admin admin] PATH_INFO: `/v3/projects/7aec676f971142c28194eb5def0794e4/users/c1457b5cb59144e6adf050932819f98e/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.842017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795c8dd-8647-4d07-a5f7-032a89149edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aec676f971142c28194eb5def0794e4, user_id=c1457b5cb59144e6adf050932819f98e, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.847945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795c8dd-8647-4d07-a5f7-032a89149edc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.848604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5385-4e24-479a-a381-913784e7ae77 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.853677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:22.855227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.855507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.855787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.868801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:22.870579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:22.890881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 823/1643] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:45:22.947913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 821/1644] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:22 2022] PUT /identity/v3/projects/7aec676f971142c28194eb5def0794e4/users/c1457b5cb59144e6adf050932819f98e/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:22.951963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:22.971437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c03526-b940-4128-a2ef-8fd9f66d1e7c service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:22.973408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290e15-a06e-48e4-b46b-8fcfbb537de2 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.973698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290e15-a06e-48e4-b46b-8fcfbb537de2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.973979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10290e15-a06e-48e4-b46b-8fcfbb537de2 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:22.976327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 822/1645] 10.222.0.21 () {54 vars in 912 bytes} [Mon Jan 31 04:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 31 04:45:22.985090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be72c-c73c-4387-8582-5915e4db5e4c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:22.985533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be72c-c73c-4387-8582-5915e4db5e4c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:22.986048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0be72c-c73c-4387-8582-5915e4db5e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.019990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-aa0be72c-c73c-4387-8582-5915e4db5e4c None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:23.021232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-aa0be72c-c73c-4387-8582-5915e4db5e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:23.114546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:23.115309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.121606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.121606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.121606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:23.121606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:23.136091 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 823/1646] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:23.137147 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0be72c-c73c-4387-8582-5915e4db5e4c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:23.146881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 824/1647] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:23.151128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:23.165438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0be72c-c73c-4387-8582-5915e4db5e4c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:23.177401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5897ad1-44d1-4b68-a5de-682ae1ac5599 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:23.184788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:23.184788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.184788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.184788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] PATH_INFO: `/v3/users/59a57cfddc61432daaea8bd2156e3124` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.185081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:23.185186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a57cfddc61432daaea8bd2156e3124)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:23.185263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.185263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.185263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] PATH_INFO: `/v3/projects/7aec676f971142c28194eb5def0794e4/users/c1457b5cb59144e6adf050932819f98e/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.185600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: WARNING py.warnings [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:45:23.185600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: warnings.warn(msg) Jan 31 04:45:23.185600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: Jan 31 04:45:23.185600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:23.193927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aec676f971142c28194eb5def0794e4, user_id=c1457b5cb59144e6adf050932819f98e, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:23.196830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:23.219354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 825/1648] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:23 2022] PUT /identity/v3/projects/7aec676f971142c28194eb5def0794e4/users/c1457b5cb59144e6adf050932819f98e/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:23.219997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:23.304949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd0cfe-b088-4e74-94ad-150db150d018 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:23.309177 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab292a-f2d7-4cd4-ad53-a48ad9cb3348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:23.309879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab292a-f2d7-4cd4-ad53-a48ad9cb3348 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.310217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab292a-f2d7-4cd4-ad53-a48ad9cb3348 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.311366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab292a-f2d7-4cd4-ad53-a48ad9cb3348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.405550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab292a-f2d7-4cd4-ad53-a48ad9cb3348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:23.410179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab292a-f2d7-4cd4-ad53-a48ad9cb3348 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:23.426137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 826/1649] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:23.427891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391aae-a185-45a9-aae2-c54b9ae13a57 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.428433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391aae-a185-45a9-aae2-c54b9ae13a57 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.428889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391aae-a185-45a9-aae2-c54b9ae13a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.464457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c3391aae-a185-45a9-aae2-c54b9ae13a57 None None] MFA Rules not processed for user `c1457b5cb59144e6adf050932819f98e`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:23.466161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c3391aae-a185-45a9-aae2-c54b9ae13a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:23.513223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a57cfddc61432daaea8bd2156e3124'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:23.568950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 827/1650] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:23.626461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a57cfddc61432daaea8bd2156e3124'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:23.627121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a57cfddc61432daaea8bd2156e3124'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:23.637025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a57cfddc61432daaea8bd2156e3124'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:23.648200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c98b4ff0-c9de-42f0-b526-96501ab71f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a57cfddc61432daaea8bd2156e3124'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:23.650177 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3391aae-a185-45a9-aae2-c54b9ae13a57 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:23.661545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3391aae-a185-45a9-aae2-c54b9ae13a57 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:23.674829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:23.676046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.676046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.676046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.679785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:23.694120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 824/1651] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:23 2022] DELETE /identity/v3/users/59a57cfddc61432daaea8bd2156e3124 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:23.700610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.704820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.704820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.720281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:23.722579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:23.734955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:23.736453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 828/1652] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:45:23.739309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:23.840809 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 825/1653] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:23.858582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:23.861740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:23.919002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a29bd2-38e0-4159-b54a-0995fdc88564 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:23.969106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a3f0-b9c1-4f92-96e3-017032cb1c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:23.969745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a3f0-b9c1-4f92-96e3-017032cb1c23 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:23.970033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a3f0-b9c1-4f92-96e3-017032cb1c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:23.970308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a3f0-b9c1-4f92-96e3-017032cb1c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:23.991002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0a3f0-b9c1-4f92-96e3-017032cb1c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:23.992564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0a3f0-b9c1-4f92-96e3-017032cb1c23 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:24.009434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:24.010000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 829/1654] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:24.010862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:24.025641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fd521-3bd4-48b7-9210-1f01a80c1526 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:24.045366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:24.046268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:24.046648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:24.047723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] PATH_INFO: `/v3/users/9886f1f479254beea6f5b16291745c69` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:24.054198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9886f1f479254beea6f5b16291745c69)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:24.054198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:24.236392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5af1-0cc0-44db-a8c8-61641496092f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:24.236724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5af1-0cc0-44db-a8c8-61641496092f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:24.236956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5af1-0cc0-44db-a8c8-61641496092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:24.305336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-61fd5af1-0cc0-44db-a8c8-61641496092f None None] MFA Rules not processed for user `b07cb89be4584e6b97df973c88daa6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:24.307345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-61fd5af1-0cc0-44db-a8c8-61641496092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:24.412291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9886f1f479254beea6f5b16291745c69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:24.424435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 830/1655] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:24.425718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:24.426009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:24.426285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:24.501914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9886f1f479254beea6f5b16291745c69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:24.502748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9886f1f479254beea6f5b16291745c69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:24.503527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9886f1f479254beea6f5b16291745c69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:24.519654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-3ae5498c-73e7-46e4-a112-c138e03b8161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9886f1f479254beea6f5b16291745c69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:24.527264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] MFA Rules not processed for user `6a6f7f126c2a4cbe80f029f352c4cafd`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:24.527264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:24.593214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 826/1656] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:24 2022] DELETE /identity/v3/users/9886f1f479254beea6f5b16291745c69 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:24.593214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbab00e-8c00-40ac-8cb9-8f66905f731b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:24.593214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbab00e-8c00-40ac-8cb9-8f66905f731b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:24.593214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbab00e-8c00-40ac-8cb9-8f66905f731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:24.613049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7bbab00e-8c00-40ac-8cb9-8f66905f731b None None] MFA Rules not processed for user `b07cb89be4584e6b97df973c88daa6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:24.614874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7bbab00e-8c00-40ac-8cb9-8f66905f731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:24.690234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 827/1657] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:24.692279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6350f95-0f80-4c25-9fa8-baf6928aaa39 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:24.692279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6350f95-0f80-4c25-9fa8-baf6928aaa39 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:24.692279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6350f95-0f80-4c25-9fa8-baf6928aaa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:24.717538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c6350f95-0f80-4c25-9fa8-baf6928aaa39 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:24.723403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c6350f95-0f80-4c25-9fa8-baf6928aaa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:24.783461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 831/1658] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:24.785187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:24.788385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:24.872839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 828/1659] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:24.875113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:24.875894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:24.875894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:24.902684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ab3f4-3d73-4558-a91b-2feb504ae4c5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:24.919936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] MFA Rules not processed for user `6a6f7f126c2a4cbe80f029f352c4cafd`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:24.921199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:25.052938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 829/1660] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:25.054678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:25.058529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:25.088545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:25.089383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.089671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.089947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.105229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a1e67-6ed4-4132-b21b-2beeb12ce88d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:25.105444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:25.116823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:25.117832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.118184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.118573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] PATH_INFO: `/v3/projects/0e7bc0c5115343e08f45aa0220dbcd94` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.119994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7bc0c5115343e08f45aa0220dbcd94)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:25.123294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:25.128256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:25.129342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:25.164184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 832/1661] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:25.166192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:25.175741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:25.251523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7d89b-a6f6-4d90-8cac-38e4104e6344 service nova] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:25.256255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:25.257022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.257299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.257574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.268905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:25.270841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:25.289088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 833/1662] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:25.289088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:25.289088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:25.299972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7bc0c5115343e08f45aa0220dbcd94', 'request_id': 'req-91f6c4ee-4886-4f8f-a584-cd7356b59943'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:25.313208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8501-b32b-442e-a5e8-5561625adbb2 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:25.391640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fbf61-ea4c-4b3b-b150-131b10cd61e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:25.392383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fbf61-ea4c-4b3b-b150-131b10cd61e5 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.392716 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fbf61-ea4c-4b3b-b150-131b10cd61e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.392996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fbf61-ea4c-4b3b-b150-131b10cd61e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.408001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7bc0c5115343e08f45aa0220dbcd94', 'request_id': 'req-91f6c4ee-4886-4f8f-a584-cd7356b59943'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:25.416696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7bc0c5115343e08f45aa0220dbcd94', 'request_id': 'req-91f6c4ee-4886-4f8f-a584-cd7356b59943'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:25.436131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] The token cache is being invalidate because project 0e7bc0c5115343e08f45aa0220dbcd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:25.437479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:25.438659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-91f6c4ee-4886-4f8f-a584-cd7356b59943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:25.442507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 830/1663] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:25 2022] DELETE /identity/v3/projects/0e7bc0c5115343e08f45aa0220dbcd94 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:25.448960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8604bc-4687-459a-844b-ec5d29993422 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.449672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8604bc-4687-459a-844b-ec5d29993422 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.450130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8604bc-4687-459a-844b-ec5d29993422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.467474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fbf61-ea4c-4b3b-b150-131b10cd61e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:25.477736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1b8604bc-4687-459a-844b-ec5d29993422 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:25.477881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fbf61-ea4c-4b3b-b150-131b10cd61e5 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:25.478240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1b8604bc-4687-459a-844b-ec5d29993422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:25.521333 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 834/1664] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:25.651402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 831/1665] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:25.665623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced474-9e5c-4e58-9bd6-413db932c173 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.666391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced474-9e5c-4e58-9bd6-413db932c173 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.666706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced474-9e5c-4e58-9bd6-413db932c173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.717710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-14ced474-9e5c-4e58-9bd6-413db932c173 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:25.724298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-14ced474-9e5c-4e58-9bd6-413db932c173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:25.763940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 835/1666] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:25.765828 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8604bc-4687-459a-844b-ec5d29993422 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:25.807626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8604bc-4687-459a-844b-ec5d29993422 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:25.824475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd034e33-91e3-4140-9a44-79fb31f228fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:25.824475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034e33-91e3-4140-9a44-79fb31f228fc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.825200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034e33-91e3-4140-9a44-79fb31f228fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.825867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd034e33-91e3-4140-9a44-79fb31f228fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.828187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034e33-91e3-4140-9a44-79fb31f228fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:25.828857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034e33-91e3-4140-9a44-79fb31f228fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:25.832650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd034e33-91e3-4140-9a44-79fb31f228fc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:25.863287 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 832/1667] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:25.865024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ced474-9e5c-4e58-9bd6-413db932c173 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:25.875530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ced474-9e5c-4e58-9bd6-413db932c173 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:25.880902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:25.883460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.883460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.883460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.883460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:25.885361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:25.956900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7914d5d-1945-4151-ba1f-44a5e674e9d7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.957831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7914d5d-1945-4151-ba1f-44a5e674e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.958824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7914d5d-1945-4151-ba1f-44a5e674e9d7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.963984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 833/1668] 10.222.0.21 () {54 vars in 912 bytes} [Mon Jan 31 04:45:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:45:25.974450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:25.975785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:25.977900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:25.980752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 836/1669] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:25 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:25.981656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.074283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] MFA Rules not processed for user `889a6422677047b6a75d1480f156ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:26.075818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:26.128920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56237afb-8f2d-4a46-8e92-1874327d2ab5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.139152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.141163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.141440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.141710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.142428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.148730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.183545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 834/1670] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:45:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:26.198842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.200685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:26.215351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575f3b-aeea-4398-a502-f8566a3c6bb2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.221757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.221757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.221757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.221757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.231497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.233209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.243608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 835/1671] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:26.256897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 837/1672] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:25 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:26.264137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.276941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025de4-c7f5-4241-bbff-5dafd0955101 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.282504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.282933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.283232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.283538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.284795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.286564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.299818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 836/1673] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:26.311320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.335902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aecd2e-bea5-4a77-b969-9d8ecd89b6d9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.343000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba7a52-c653-49da-88df-ce6327f5c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.345806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba7a52-c653-49da-88df-ce6327f5c55e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.346168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba7a52-c653-49da-88df-ce6327f5c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.347155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba7a52-c653-49da-88df-ce6327f5c55e admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.348494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba7a52-c653-49da-88df-ce6327f5c55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.350679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba7a52-c653-49da-88df-ce6327f5c55e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.432196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 838/1674] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:26.432431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.432431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c8b31-1484-440e-884a-edebedd7e50e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.432431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86191421-81f2-40c9-97e5-def4dedaa079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.432431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191421-81f2-40c9-97e5-def4dedaa079 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.433063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191421-81f2-40c9-97e5-def4dedaa079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.433063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191421-81f2-40c9-97e5-def4dedaa079 admin admin] PATH_INFO: `/v3/projects/bd0b35e3f5cf47f2a248b1ddee48e0e9/users/f5f45e0cc96d47ddaeb0f9cfc10445ac/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.457890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86191421-81f2-40c9-97e5-def4dedaa079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0b35e3f5cf47f2a248b1ddee48e0e9, user_id=f5f45e0cc96d47ddaeb0f9cfc10445ac, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.460903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86191421-81f2-40c9-97e5-def4dedaa079 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.540898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 837/1675] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:26 2022] PUT /identity/v3/projects/bd0b35e3f5cf47f2a248b1ddee48e0e9/users/f5f45e0cc96d47ddaeb0f9cfc10445ac/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:26.552478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85910d8b-b775-490a-8043-7c72254e90a1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.552778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85910d8b-b775-490a-8043-7c72254e90a1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.553058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85910d8b-b775-490a-8043-7c72254e90a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.564025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe03f8-2ff0-4a38-995b-efbd75b86192 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.564529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe03f8-2ff0-4a38-995b-efbd75b86192 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.564969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe03f8-2ff0-4a38-995b-efbd75b86192 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.568044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 838/1676] 10.222.0.21 () {54 vars in 912 bytes} [Mon Jan 31 04:45:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:45:26.574029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.574554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.575008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.613397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] MFA Rules not processed for user `889a6422677047b6a75d1480f156ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:26.614416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-85910d8b-b775-490a-8043-7c72254e90a1 None None] MFA Rules not processed for user `f5f45e0cc96d47ddaeb0f9cfc10445ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:26.614639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:26.615841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-85910d8b-b775-490a-8043-7c72254e90a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:26.715499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 839/1677] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:26.719066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85910d8b-b775-490a-8043-7c72254e90a1 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.731372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 839/1678] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:26.745094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.751210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:26.773064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65d9f8-ef99-4499-a77f-4558375e7f13 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.778603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.779646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.780394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.781502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.795060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.798063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.809735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85910d8b-b775-490a-8043-7c72254e90a1 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.810607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 840/1679] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:26.811521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:26.814041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:26.816786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.817928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.818447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.819015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.820006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.823112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.841729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ce6f5-12bb-4fd9-9571-5cca6b402896 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:26.850502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:26.852350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:26.852618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:26.852917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] PATH_INFO: `/v3/projects/fb88cf656be440459fcc510c5486f886` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:26.854370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb88cf656be440459fcc510c5486f886)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:26.861476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:26.938830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 840/1680] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:26 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:45:26.942532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:27.014612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb88cf656be440459fcc510c5486f886', 'request_id': 'req-845b3f18-b2c6-43ce-8dcc-847f582a495e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.071051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f044-af20-4dea-9cf8-5adda7f618bb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:27.111402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb88cf656be440459fcc510c5486f886', 'request_id': 'req-845b3f18-b2c6-43ce-8dcc-847f582a495e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.121429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb88cf656be440459fcc510c5486f886', 'request_id': 'req-845b3f18-b2c6-43ce-8dcc-847f582a495e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.142628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] The token cache is being invalidate because project fb88cf656be440459fcc510c5486f886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:27.143129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.144001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.148442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 841/1681] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:26 2022] DELETE /identity/v3/projects/fb88cf656be440459fcc510c5486f886 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:27.149436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:27.156584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:27.179124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:27.180137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:27.180421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:27.180870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:27.181601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:27.186996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:27.308135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 841/1682] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:26 2022] POST /identity/v3/users => generated 288 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:45:27.308135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:27.314104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:27.318288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b3f18-b2c6-43ce-8dcc-847f582a495e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:27.324569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:27.325356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:27.325741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:27.326082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:27.330272 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c9fc6-879f-4f2c-acb3-9d3bc9520ffe admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:27.352968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:27.357859 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:27.362559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:27.362911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:27.366509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] PATH_INFO: `/v3/users/c1457b5cb59144e6adf050932819f98e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:27.369489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1457b5cb59144e6adf050932819f98e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:27.371829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:27.388311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:27.391000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:27.415213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 842/1683] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:27.418065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:27.418508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:27.435935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe4772-57fb-47a5-8ba6-99ebf78f933b service placement] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:27.449612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:27.450448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:27.450847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:27.451218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:27.452061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:27.453852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:27.475398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 843/1684] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:27.485801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:27.525222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdfc69-cab2-4a6c-b419-6b8b8d356859 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:27.545876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:27.548590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:27.548875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:27.555917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] PATH_INFO: `/v3/projects/22e2be453e334f0f8edd59c70b3c9650/users/c72045842c614930858a235c6af9bd47/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:27.583898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e2be453e334f0f8edd59c70b3c9650, user_id=c72045842c614930858a235c6af9bd47, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:27.591079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:27.626003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1457b5cb59144e6adf050932819f98e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.626771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1457b5cb59144e6adf050932819f98e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.648124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1457b5cb59144e6adf050932819f98e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.668720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1457b5cb59144e6adf050932819f98e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.710381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 844/1685] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:27 2022] PUT /identity/v3/projects/22e2be453e334f0f8edd59c70b3c9650/users/c72045842c614930858a235c6af9bd47/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:27.714424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:27.758169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1457b5cb59144e6adf050932819f98e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:27.771354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 842/1686] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:27 2022] DELETE /identity/v3/users/c1457b5cb59144e6adf050932819f98e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:27.854161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168fe59-e1d3-4e54-9b0a-54e5624ed316 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:27.948594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a048-e172-4da0-9a96-74f2f9869f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:27.949633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a048-e172-4da0-9a96-74f2f9869f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:27.950394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a048-e172-4da0-9a96-74f2f9869f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:27.950918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a048-e172-4da0-9a96-74f2f9869f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:27.951897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a048-e172-4da0-9a96-74f2f9869f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:27.961841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a048-e172-4da0-9a96-74f2f9869f24 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:27.977679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 845/1687] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:27.981623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:27.983648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:28.002299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb201d-ae5e-4f14-bd48-fcdfa62fae6c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:28.020886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:28.021797 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:28.022683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:28.022998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] PATH_INFO: `/v3/projects/22e2be453e334f0f8edd59c70b3c9650/users/c72045842c614930858a235c6af9bd47/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:28.029909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e2be453e334f0f8edd59c70b3c9650, user_id=c72045842c614930858a235c6af9bd47, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:28.033721 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:28.109233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 843/1688] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:27 2022] PUT /identity/v3/projects/22e2be453e334f0f8edd59c70b3c9650/users/c72045842c614930858a235c6af9bd47/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:28.131837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:28.132856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:28.133363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:28.256956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] MFA Rules not processed for user `c72045842c614930858a235c6af9bd47`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:28.266133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:28.541551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 846/1689] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:28.554944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:28.565136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:28.737234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026260-1c4a-4c28-9bd3-bbd3089b7ce1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:28.748989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:28.752756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:28.753058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:28.753773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:28.774814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:28.778522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:28.793683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 844/1690] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:29.128699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:29.131914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:29.147512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d426da2-63d8-4d74-b940-072e4ffbd2d3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:29.151969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5012684-491f-4854-a059-f3178b253c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:29.152739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5012684-491f-4854-a059-f3178b253c5e service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:29.153137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5012684-491f-4854-a059-f3178b253c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:29.154255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5012684-491f-4854-a059-f3178b253c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:29.157559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a5012684-491f-4854-a059-f3178b253c5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:29.188151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:29.190813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:29.233292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5012684-491f-4854-a059-f3178b253c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:29.233472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5012684-491f-4854-a059-f3178b253c5e service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:29.287215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 847/1691] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:29.549285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111ca19-1382-458c-9c22-4dfe7958766f service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:29.549285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:29.549285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:29.549285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:29.550590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] PATH_INFO: `/v3/projects/7aec676f971142c28194eb5def0794e4` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:29.550590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aec676f971142c28194eb5def0794e4)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:29.550590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: WARNING py.warnings [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 31 04:45:29.550590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: warnings.warn(msg) Jan 31 04:45:29.550590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: Jan 31 04:45:29.550590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:29.550590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aec676f971142c28194eb5def0794e4', 'request_id': 'req-05592119-b658-445e-b981-1f900fbb5191'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:29.551356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aec676f971142c28194eb5def0794e4', 'request_id': 'req-05592119-b658-445e-b981-1f900fbb5191'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:29.778451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aec676f971142c28194eb5def0794e4', 'request_id': 'req-05592119-b658-445e-b981-1f900fbb5191'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:29.823505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] The token cache is being invalidate because project 7aec676f971142c28194eb5def0794e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:29.823959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:29.826191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05592119-b658-445e-b981-1f900fbb5191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:29.834041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 845/1692] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:29 2022] DELETE /identity/v3/projects/7aec676f971142c28194eb5def0794e4 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:29.835318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb3625-b3ff-479f-9bc3-0a47bf6980c0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:29.835638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb3625-b3ff-479f-9bc3-0a47bf6980c0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:29.835916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb3625-b3ff-479f-9bc3-0a47bf6980c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:29.878053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-95bb3625-b3ff-479f-9bc3-0a47bf6980c0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:29.879478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-95bb3625-b3ff-479f-9bc3-0a47bf6980c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:30.078093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 848/1693] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:30.078298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ab87-5e11-44e1-91fe-910a2ca204a7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:30.078593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ab87-5e11-44e1-91fe-910a2ca204a7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:30.078901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ab87-5e11-44e1-91fe-910a2ca204a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:30.180691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9e09ab87-5e11-44e1-91fe-910a2ca204a7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:30.180691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9e09ab87-5e11-44e1-91fe-910a2ca204a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:30.214172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 846/1694] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:30.218863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb3625-b3ff-479f-9bc3-0a47bf6980c0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:30.230187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb3625-b3ff-479f-9bc3-0a47bf6980c0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:30.236524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:30.237626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:30.238186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:30.238656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:30.239695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:30.240204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:30.242921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:30.261659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 849/1695] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:30.262495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ab87-5e11-44e1-91fe-910a2ca204a7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:30.280631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ab87-5e11-44e1-91fe-910a2ca204a7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:30.300574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:30.301308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:30.301594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:30.301871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:30.302609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:30.304828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:30.495995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 847/1696] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:30 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:45:30.500389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:30.515672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759060e-e91a-4ae1-b17b-db179665e1cd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:30.641368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:30.642100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:30.642350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:30.642621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:30.644833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:30.647258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:30.771482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 850/1697] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:30 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:30.776462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:30.792879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984ca3-166c-4e1f-b00e-9ea69f664975 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:30.807427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:30.808266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:30.808630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:30.809025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:30.809855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:30.814068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:30.860412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:30.860846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 848/1698] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:30.871627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4bbd-ffcc-487b-b041-8cf28ca740c2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:30.899288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76353abd-16f1-4517-bcb2-a2a7fa7e8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:30.899998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353abd-16f1-4517-bcb2-a2a7fa7e8208 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:30.900280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353abd-16f1-4517-bcb2-a2a7fa7e8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:30.900560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353abd-16f1-4517-bcb2-a2a7fa7e8208 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:30.901349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76353abd-16f1-4517-bcb2-a2a7fa7e8208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:30.902963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76353abd-16f1-4517-bcb2-a2a7fa7e8208 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:30.939165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 851/1699] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:30.943720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:30.959468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bacba-da60-471f-920b-05db623dbb1d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:30.969164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:30.970365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:30.970954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:30.971233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] PATH_INFO: `/v3/projects/cd62513ac7f94075a5750ccacdff8f48/users/9b5825bb4b7e4dd39c32e5ffbb05caf5/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:30.995224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd62513ac7f94075a5750ccacdff8f48, user_id=9b5825bb4b7e4dd39c32e5ffbb05caf5, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:30.999036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:31.089583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 849/1700] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:30 2022] PUT /identity/v3/projects/cd62513ac7f94075a5750ccacdff8f48/users/9b5825bb4b7e4dd39c32e5ffbb05caf5/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:31.091652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a447-0441-4f5a-827f-03ea51456255 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:31.091945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a447-0441-4f5a-827f-03ea51456255 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:31.092224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724a447-0441-4f5a-827f-03ea51456255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:31.139158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9724a447-0441-4f5a-827f-03ea51456255 None None] MFA Rules not processed for user `9b5825bb4b7e4dd39c32e5ffbb05caf5`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:31.141701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9724a447-0441-4f5a-827f-03ea51456255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:31.320283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 852/1701] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:31.322453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:31.447227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f203c4-4449-4f15-a3e1-a97f8922762c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:31.454435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95d04b-1333-49af-8fcb-81a0d586ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:31.456469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95d04b-1333-49af-8fcb-81a0d586ee23 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:31.456822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95d04b-1333-49af-8fcb-81a0d586ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:31.457470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95d04b-1333-49af-8fcb-81a0d586ee23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:31.458752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95d04b-1333-49af-8fcb-81a0d586ee23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:31.462342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95d04b-1333-49af-8fcb-81a0d586ee23 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:31.596564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 850/1702] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:31 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:31.601208 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a447-0441-4f5a-827f-03ea51456255 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:31.616604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724a447-0441-4f5a-827f-03ea51456255 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:31.738267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128d0ab-d438-4e89-9bc3-30ca22fccd20 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:31.738539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128d0ab-d438-4e89-9bc3-30ca22fccd20 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:31.738748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128d0ab-d438-4e89-9bc3-30ca22fccd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:31.744237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:31.745921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:31.745921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:31.746095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:31.747184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:31.750107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:31.778502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-0128d0ab-d438-4e89-9bc3-30ca22fccd20 None None] MFA Rules not processed for user `25740a911eb440c2a81d4dbcbba95c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:31.779830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0128d0ab-d438-4e89-9bc3-30ca22fccd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:31.851381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 853/1703] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:31 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:31.862250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:31.867278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 851/1704] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:31.875860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033226b3-e47a-4387-a219-05b1b872dfa8 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:31.876146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033226b3-e47a-4387-a219-05b1b872dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:31.879680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033226b3-e47a-4387-a219-05b1b872dfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:31.885407 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d5b8-05c7-4f96-87db-f35a9157561c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:31.899321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:31.908255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:31.908255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:31.908255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:31.908255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:31.908255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:31.915335 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-033226b3-e47a-4387-a219-05b1b872dfa8 None None] MFA Rules not processed for user `25740a911eb440c2a81d4dbcbba95c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:31.916661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-033226b3-e47a-4387-a219-05b1b872dfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:31.929250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 852/1705] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:31.929431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 854/1706] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:31.932707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033226b3-e47a-4387-a219-05b1b872dfa8 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:31.944963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:31.947884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033226b3-e47a-4387-a219-05b1b872dfa8 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:31.949611 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:31.954418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:31.955774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:31.956245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:31.957046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] PATH_INFO: `/v3/projects/01d89cdef5fe4498b37aca20261a8181/users/17b0ea5c2fce458aa4c1ac99f735e96a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:31.981680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d89cdef5fe4498b37aca20261a8181, user_id=17b0ea5c2fce458aa4c1ac99f735e96a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:31.986099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:32.050816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 853/1707] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:31 2022] PUT /identity/v3/projects/01d89cdef5fe4498b37aca20261a8181/users/17b0ea5c2fce458aa4c1ac99f735e96a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:32.054757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:32.636294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e97b8-1ccd-4999-8cf3-2e9896e704a6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:32.644676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab2fe7-80c6-46b7-a5f8-640b5f9d29de admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:32.644676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14820a-3676-44fa-bc9f-ff20252c44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:32.644676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14820a-3676-44fa-bc9f-ff20252c44fe admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:32.644676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14820a-3676-44fa-bc9f-ff20252c44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:32.658371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14820a-3676-44fa-bc9f-ff20252c44fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:32.658371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14820a-3676-44fa-bc9f-ff20252c44fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:32.658371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14820a-3676-44fa-bc9f-ff20252c44fe admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:32.658371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 854/1708] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:45:32.658371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8df87b-ee57-4518-9ce8-bf3ad3be48a1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:32.658371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8df87b-ee57-4518-9ce8-bf3ad3be48a1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:32.659981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8df87b-ee57-4518-9ce8-bf3ad3be48a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:32.660756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:32.660756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:32.660756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:32.660756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:32.661751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-de8df87b-ee57-4518-9ce8-bf3ad3be48a1 None None] MFA Rules not processed for user `aa68ebb7220c4e6383128947fc970877`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:32.661751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-de8df87b-ee57-4518-9ce8-bf3ad3be48a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:32.662448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:32.662448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:32.662448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 855/1709] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:45:32.662448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:32.662448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8125ceb-1a41-404e-ba2e-315c17b771c9 service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:32.664060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:32.664060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:32.664060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:32.664060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] PATH_INFO: `/v3/projects/01d89cdef5fe4498b37aca20261a8181/users/17b0ea5c2fce458aa4c1ac99f735e96a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:32.665054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d89cdef5fe4498b37aca20261a8181, user_id=17b0ea5c2fce458aa4c1ac99f735e96a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:32.665054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:32.665301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 855/1710] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:32.665505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 856/1711] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:32 2022] PUT /identity/v3/projects/01d89cdef5fe4498b37aca20261a8181/users/17b0ea5c2fce458aa4c1ac99f735e96a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:32.665637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:32.665637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:32.665637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:32.665637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] MFA Rules not processed for user `17b0ea5c2fce458aa4c1ac99f735e96a`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:32.665637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:32.666282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:32.666282 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:32.668926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 856/1712] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:32.684572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:32.689185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:32.745157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330217c6-c3d1-4b2b-a0ea-23b18f88ee4b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:32.753680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:32.754704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:32.755232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:32.755706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:32.764031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b598e-3e59-4010-ace5-e50d23f33aff None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:32.769329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946713d7-eee9-4b30-b55a-226d34b8234e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:32.770018 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946713d7-eee9-4b30-b55a-226d34b8234e service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:32.770282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946713d7-eee9-4b30-b55a-226d34b8234e service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:32.770553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946713d7-eee9-4b30-b55a-226d34b8234e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:32.784468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946713d7-eee9-4b30-b55a-226d34b8234e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:32.786099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946713d7-eee9-4b30-b55a-226d34b8234e service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:32.798154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 857/1713] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:45:32.841322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:32.844113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:32.870639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 857/1714] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:45:33.832108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8be10-6d97-48a1-affc-a5a6b23ad56c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:33.832568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8be10-6d97-48a1-affc-a5a6b23ad56c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:33.832838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8be10-6d97-48a1-affc-a5a6b23ad56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:33.885566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-4ca8be10-6d97-48a1-affc-a5a6b23ad56c None None] MFA Rules not processed for user `25740a911eb440c2a81d4dbcbba95c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:33.888762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4ca8be10-6d97-48a1-affc-a5a6b23ad56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:33.971526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 858/1715] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:33.975515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:33.997032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520740cb-4fa5-420d-b88b-1e30b2d0810c service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:34.008964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b0ea5c2fce458aa4c1ac99f735e96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d89cdef5fe4498b37aca20261a8181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:34.010221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:34.011246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:34.011724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:34.014163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:34.014980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:34.016982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:34.029743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 858/1716] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:45:34.034232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8be10-6d97-48a1-affc-a5a6b23ad56c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:34.046586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8be10-6d97-48a1-affc-a5a6b23ad56c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:34.058860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b0ea5c2fce458aa4c1ac99f735e96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d89cdef5fe4498b37aca20261a8181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:34.058860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:34.058860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:34.059338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:34.059338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:34.059338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:34.160699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 859/1717] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:34 2022] POST /identity/v3/projects => generated 354 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:34.166230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:34.190610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a54a9-1348-46eb-96af-effe1849cba0 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:34.282165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b0ea5c2fce458aa4c1ac99f735e96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d89cdef5fe4498b37aca20261a8181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:34.282869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:34.283163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:34.283448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:34.285335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:34.285675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:34.287695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:34.309231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 859/1718] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:45:34.356303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:34.368151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72d807-d5f6-4558-99e4-9ffc6904b158 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:34.373230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17b0ea5c2fce458aa4c1ac99f735e96a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01d89cdef5fe4498b37aca20261a8181', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:34.374205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:34.374722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:34.375097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] PATH_INFO: `/v3/projects/225652e4a5ca4515b4476ae319aa9e88` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:34.376364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorizing `identity:delete_project(project_id=225652e4a5ca4515b4476ae319aa9e88)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:34.378354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:34.536451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225652e4a5ca4515b4476ae319aa9e88', 'request_id': 'req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:34.543168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225652e4a5ca4515b4476ae319aa9e88', 'request_id': 'req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:34.626633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225652e4a5ca4515b4476ae319aa9e88', 'request_id': 'req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:34.651773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] The token cache is being invalidate because project 225652e4a5ca4515b4476ae319aa9e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:34.652221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:34.655031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1bdbbdf4-2a14-4213-8523-0ef11c7e8467 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:34.658401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 860/1719] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:34 2022] DELETE /identity/v3/projects/225652e4a5ca4515b4476ae319aa9e88 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:35.898184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:35.902158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:36.041886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208052-07de-4279-b2ac-36cc4b166c37 tempest-VolumeQuotaClassesTest-402333047 tempest-VolumeQuotaClassesTest-402333047-project-admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:36.237319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:36.238292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:36.241580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:36.241580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] PATH_INFO: `/v3/users/9b5825bb4b7e4dd39c32e5ffbb05caf5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:36.243412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5825bb4b7e4dd39c32e5ffbb05caf5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:36.248015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:36.563735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5825bb4b7e4dd39c32e5ffbb05caf5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:36.686137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5825bb4b7e4dd39c32e5ffbb05caf5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:36.687303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5825bb4b7e4dd39c32e5ffbb05caf5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:36.687936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5825bb4b7e4dd39c32e5ffbb05caf5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:36.699656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5825bb4b7e4dd39c32e5ffbb05caf5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:36.751690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 860/1720] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:35 2022] DELETE /identity/v3/users/9b5825bb4b7e4dd39c32e5ffbb05caf5 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:36.756226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19543-7312-4aeb-b6b0-c27af039bee3 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:36.756804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19543-7312-4aeb-b6b0-c27af039bee3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:36.756804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19543-7312-4aeb-b6b0-c27af039bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:36.793013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f8c19543-7312-4aeb-b6b0-c27af039bee3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:36.794234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f8c19543-7312-4aeb-b6b0-c27af039bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:36.990775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 861/1721] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:37.000000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:37.001018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:37.170096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136b13-c2f8-4801-a6b0-86c5911982d8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:37.178371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21799151-e4a3-4f70-b009-edf30721a6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:37.179424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799151-e4a3-4f70-b009-edf30721a6ef service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:37.181115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799151-e4a3-4f70-b009-edf30721a6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:37.181649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799151-e4a3-4f70-b009-edf30721a6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:37.230628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21799151-e4a3-4f70-b009-edf30721a6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:37.232364 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21799151-e4a3-4f70-b009-edf30721a6ef service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:37.259048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 861/1722] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:38.047836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:38.054351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:38.056529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:38.112571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:38.114042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:38.145001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:38.145738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:38.145738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:38.192298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] MFA Rules not processed for user `aa68ebb7220c4e6383128947fc970877`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:38.193547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:38.372979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 862/1723] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:45:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:38.400363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 862/1724] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:38.754259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:38.758350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:38.780375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec4cd-12f7-48f9-b7b1-873a78ff19c2 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:38.785794 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:38.786640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:38.787164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:38.787598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] PATH_INFO: `/v3/projects/cd62513ac7f94075a5750ccacdff8f48` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:38.788974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd62513ac7f94075a5750ccacdff8f48)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:38.791228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:38.870085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:38.873053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:38.942779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd62513ac7f94075a5750ccacdff8f48', 'request_id': 'req-de00634a-c918-46f1-b2e2-2d5a83cabea2'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:38.962643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd62513ac7f94075a5750ccacdff8f48', 'request_id': 'req-de00634a-c918-46f1-b2e2-2d5a83cabea2'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:38.973837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c990b4e-cb1a-4760-98a5-a9f26c39f527 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:39.078562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd62513ac7f94075a5750ccacdff8f48', 'request_id': 'req-de00634a-c918-46f1-b2e2-2d5a83cabea2'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.081260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:39.082045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:39.082509 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:39.082967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:39.101134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] The token cache is being invalidate because project cd62513ac7f94075a5750ccacdff8f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:39.102109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.102855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.105098 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 863/1725] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:38 2022] DELETE /identity/v3/projects/cd62513ac7f94075a5750ccacdff8f48 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:39.110587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:39.125950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:39.228729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:39.230354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:39.259448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 863/1726] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:45:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:45:39.296104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00634a-c918-46f1-b2e2-2d5a83cabea2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:39.313873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:39.315364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:39.316637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:39.317151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] PATH_INFO: `/v3/users/17b0ea5c2fce458aa4c1ac99f735e96a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:39.318722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b0ea5c2fce458aa4c1ac99f735e96a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:39.322364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:39.487383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:39.489004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:39.515575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09410-e1a9-45b6-8088-0566589d9e84 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:39.547841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:39.548740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:39.552855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:39.552855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] PATH_INFO: `/v3/users/1f4ee973a7a044a8a460caddd78566d3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:39.552855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4ee973a7a044a8a460caddd78566d3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:39.555472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:39.600203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b0ea5c2fce458aa4c1ac99f735e96a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.601017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b0ea5c2fce458aa4c1ac99f735e96a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.650606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b0ea5c2fce458aa4c1ac99f735e96a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.692120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b0ea5c2fce458aa4c1ac99f735e96a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.813092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-322d9bc5-3192-49bd-a717-f5d3827761ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b0ea5c2fce458aa4c1ac99f735e96a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.831778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 864/1727] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:39 2022] DELETE /identity/v3/users/17b0ea5c2fce458aa4c1ac99f735e96a => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:39.871740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4ee973a7a044a8a460caddd78566d3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.943696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4ee973a7a044a8a460caddd78566d3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.944963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4ee973a7a044a8a460caddd78566d3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.945676 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4ee973a7a044a8a460caddd78566d3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.958143 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4ee973a7a044a8a460caddd78566d3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:39.986443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 864/1728] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:39 2022] DELETE /identity/v3/users/1f4ee973a7a044a8a460caddd78566d3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:39.988726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:39.989596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:39.989890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:40.015942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:40.017512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:40.122063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 865/1729] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:40.145859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:40.147335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:40.267075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249ce3d-5fb4-4a26-9b46-f5521dc5cc05 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:40.303054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6c4c-572d-454c-b29c-9ce2a90a09bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:40.304462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6c4c-572d-454c-b29c-9ce2a90a09bd service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:40.304935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6c4c-572d-454c-b29c-9ce2a90a09bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:40.305775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6c4c-572d-454c-b29c-9ce2a90a09bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:40.327893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6c4c-572d-454c-b29c-9ce2a90a09bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:40.327893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6c4c-572d-454c-b29c-9ce2a90a09bd service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:40.344760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 865/1730] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:40.846310 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:40.847748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:40.860958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7ade9-ebae-4721-a0a9-98aa7baa3a4e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:40.866024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:40.866914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:40.867194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:40.867458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] PATH_INFO: `/v3/projects/01d89cdef5fe4498b37aca20261a8181` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:40.869476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d89cdef5fe4498b37aca20261a8181)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:40.871458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.019700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d89cdef5fe4498b37aca20261a8181', 'request_id': 'req-badf6c6c-cf48-492a-9eb0-1a7ef673895a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.026677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d89cdef5fe4498b37aca20261a8181', 'request_id': 'req-badf6c6c-cf48-492a-9eb0-1a7ef673895a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.099516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d89cdef5fe4498b37aca20261a8181', 'request_id': 'req-badf6c6c-cf48-492a-9eb0-1a7ef673895a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.111891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] The token cache is being invalidate because project 01d89cdef5fe4498b37aca20261a8181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:41.112168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.112797 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-badf6c6c-cf48-492a-9eb0-1a7ef673895a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.114330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 866/1731] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:40 2022] DELETE /identity/v3/projects/01d89cdef5fe4498b37aca20261a8181 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:41.121803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.122093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.122397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.145140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:41.146348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:41.207899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 866/1732] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:41.217398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8086-0769-4d87-9b2c-ea54f96bd300 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.218683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8086-0769-4d87-9b2c-ea54f96bd300 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.218683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8086-0769-4d87-9b2c-ea54f96bd300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.236323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.239726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:41.242370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-045b8086-0769-4d87-9b2c-ea54f96bd300 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:41.247051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-045b8086-0769-4d87-9b2c-ea54f96bd300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:41.259230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 867/1733] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:41.268176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8086-0769-4d87-9b2c-ea54f96bd300 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.270354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8086-0769-4d87-9b2c-ea54f96bd300 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.275561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.276206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.276487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.276777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.277501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:41.277800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.279112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cad8c-8ce7-4a21-9ce1-906148874fe2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.279574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.286258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.287192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.287479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.287750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] PATH_INFO: `/v3/projects/f7bb7271fb4d4239a0b83b74df4c14b0` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.289231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7bb7271fb4d4239a0b83b74df4c14b0)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.291254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.295247 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 868/1734] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:41.299937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.311239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb763739-1004-4d0b-8d56-c0409c428b59 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.316866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.319909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.319909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.319909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.319909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.321258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.465461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 869/1735] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:41.470711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.479901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7bb7271fb4d4239a0b83b74df4c14b0', 'request_id': 'req-f95c8de9-4a09-441c-bc4d-5caac917a89e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.572780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5de4-2e8f-40bf-8618-a9745f8d92f3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.579156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.580085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.580506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.580926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.582279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.584687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.613549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7bb7271fb4d4239a0b83b74df4c14b0', 'request_id': 'req-f95c8de9-4a09-441c-bc4d-5caac917a89e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.628016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7bb7271fb4d4239a0b83b74df4c14b0', 'request_id': 'req-f95c8de9-4a09-441c-bc4d-5caac917a89e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.643298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] The token cache is being invalidate because project f7bb7271fb4d4239a0b83b74df4c14b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:41.643816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.644762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f95c8de9-4a09-441c-bc4d-5caac917a89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:41.648424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 867/1736] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:41 2022] DELETE /identity/v3/projects/f7bb7271fb4d4239a0b83b74df4c14b0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:41.654488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4ab7-2a6a-4e1a-b7ff-e1b3d9d22358 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.661570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4ab7-2a6a-4e1a-b7ff-e1b3d9d22358 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.661570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4ab7-2a6a-4e1a-b7ff-e1b3d9d22358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.693969 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 870/1737] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:45:41.695044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.700605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:41.724804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2b8f4ab7-2a6a-4e1a-b7ff-e1b3d9d22358 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:41.725499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dcee8-8019-4755-a338-8ee8a1a8a48f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.726013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2b8f4ab7-2a6a-4e1a-b7ff-e1b3d9d22358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:41.741973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 868/1738] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:41.742158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.742158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.742158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.742158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.742486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.742486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.743560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912f1f-30fd-410a-b1d3-f29f23192529 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.743849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912f1f-30fd-410a-b1d3-f29f23192529 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.744124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70912f1f-30fd-410a-b1d3-f29f23192529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.755142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 871/1739] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:41.759031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.772416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8417803-766f-4cbe-9c45-18b872bdf6ed admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.772810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-70912f1f-30fd-410a-b1d3-f29f23192529 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:41.775804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-70912f1f-30fd-410a-b1d3-f29f23192529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:41.780129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.780921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.781290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.781671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.782453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.785752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.795825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 869/1740] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:41.797188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70912f1f-30fd-410a-b1d3-f29f23192529 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.797660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 872/1741] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:45:41.801440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.815144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6fd2c-6f91-4258-a0ea-04384a142d40 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.815809 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70912f1f-30fd-410a-b1d3-f29f23192529 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.822984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.823727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.824005 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.824272 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.825469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:41.825469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.826998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.828188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40098305-f345-448d-8666-b1f291252e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.829260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40098305-f345-448d-8666-b1f291252e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.829540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40098305-f345-448d-8666-b1f291252e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.829816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40098305-f345-448d-8666-b1f291252e67 admin admin] PATH_INFO: `/v3/projects/fe5722a33cc64c83bdb7dc1bf4bd02b4/users/dd60bb2f0c88443eb7a38df99804eed0/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.842827 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 870/1742] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:41.844440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.847655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40098305-f345-448d-8666-b1f291252e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5722a33cc64c83bdb7dc1bf4bd02b4, user_id=dd60bb2f0c88443eb7a38df99804eed0, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.852898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40098305-f345-448d-8666-b1f291252e67 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.858939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc3d56-9081-40a8-8010-23be8ed917fa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:41.864126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:41.864781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.865059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.865329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.866144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:41.868117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:41.928447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 873/1743] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:41 2022] PUT /identity/v3/projects/fe5722a33cc64c83bdb7dc1bf4bd02b4/users/dd60bb2f0c88443eb7a38df99804eed0/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:41.939208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cf10c-5f11-4449-9a64-dc8960c30a83 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:41.939562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cf10c-5f11-4449-9a64-dc8960c30a83 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:41.939842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cf10c-5f11-4449-9a64-dc8960c30a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:41.953356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 871/1744] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:41.960146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:41.966543 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-244cf10c-5f11-4449-9a64-dc8960c30a83 None None] MFA Rules not processed for user `dd60bb2f0c88443eb7a38df99804eed0`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:41.968105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-244cf10c-5f11-4449-9a64-dc8960c30a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:42.028969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a0076-2d98-423d-a4e3-b4c2ac13bd37 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.037607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.038350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.038638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.038951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.040406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.042759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.048002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 874/1745] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:42.048893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cf10c-5f11-4449-9a64-dc8960c30a83 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.066647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cf10c-5f11-4449-9a64-dc8960c30a83 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.087092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.087757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.088088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.088391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.099845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.099845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.122219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 872/1746] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:41 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:42.127085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.136955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f070f09-28d0-4034-bf51-88c933a9cb09 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.141736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.142367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.142653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.142992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.143743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.145335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.154916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 873/1747] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:42.158600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.164241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 875/1748] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:42 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:42.171993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c202067-90c2-43cd-9b4d-8d095f1d9b68 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.174996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.223655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.224460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.224742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.225017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.225756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.227568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.237065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978fb74-3dd1-4252-a8ac-25ef99506255 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.238357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 874/1749] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:45:42.242748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.245079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.245769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.246078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.246354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.247088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.249571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.252901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966d6f7-6ee7-4c18-9571-049eda776ee5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.258187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265d48-298a-45b7-b78a-e9c00ed1e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.259163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265d48-298a-45b7-b78a-e9c00ed1e76d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.266595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265d48-298a-45b7-b78a-e9c00ed1e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.266595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265d48-298a-45b7-b78a-e9c00ed1e76d admin admin] PATH_INFO: `/v3/projects/8650f4719642413691a8dbe3746b2db4/users/936d0f6110c64fb189e8ac21449da16e/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.278721 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265d48-298a-45b7-b78a-e9c00ed1e76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8650f4719642413691a8dbe3746b2db4, user_id=936d0f6110c64fb189e8ac21449da16e, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.282263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265d48-298a-45b7-b78a-e9c00ed1e76d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.409760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 876/1750] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:42 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:45:42.413468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.424784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7aaf9-611c-448a-b2b7-8dda6a6f81c9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.431051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.433245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.433245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.433245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.433245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.434749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.452648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 877/1751] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:45:42.458270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.465079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 875/1752] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:42 2022] PUT /identity/v3/projects/8650f4719642413691a8dbe3746b2db4/users/936d0f6110c64fb189e8ac21449da16e/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:42.469683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9fee6-75ad-4651-8037-6141a74cd709 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.471302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.471637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.472060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.495810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:42.497470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:42.537833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.538545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.538858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.539296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] PATH_INFO: `/v3/projects/034aa827401842beb00358f2638d0069/users/3e5b4f84747844248092fe4ccfa41619/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.562753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=034aa827401842beb00358f2638d0069, user_id=3e5b4f84747844248092fe4ccfa41619, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.565544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.576099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 876/1753] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:42.590976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.593203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:42.665078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6bd08-8f80-428a-b9d9-812e851fa4b9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.665078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.665078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.665640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.665640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.672191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 878/1754] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:42 2022] PUT /identity/v3/projects/034aa827401842beb00358f2638d0069/users/3e5b4f84747844248092fe4ccfa41619/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:42.699340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.699340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.699340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 877/1755] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:42.699695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.776193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647e980-3380-403a-8ae1-c39091a04dfc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.783554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840f663-e386-4ab7-b378-2ee76d0945d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.784262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f663-e386-4ab7-b378-2ee76d0945d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.784572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f663-e386-4ab7-b378-2ee76d0945d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.784881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f663-e386-4ab7-b378-2ee76d0945d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.785663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840f663-e386-4ab7-b378-2ee76d0945d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.787438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840f663-e386-4ab7-b378-2ee76d0945d1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.800458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 879/1756] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:42.807328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:42.817752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3fb8e-d2a7-4eef-9f95-8578c67fcc40 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:42.824055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:42.825016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.825296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.825569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] PATH_INFO: `/v3/projects/034aa827401842beb00358f2638d0069/users/3e5b4f84747844248092fe4ccfa41619/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.828129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] RBAC: Authorizing `identity:create_grant(project_id=034aa827401842beb00358f2638d0069, user_id=3e5b4f84747844248092fe4ccfa41619, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:42.831064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:42.855292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 878/1757] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:42 2022] PUT /identity/v3/projects/034aa827401842beb00358f2638d0069/users/3e5b4f84747844248092fe4ccfa41619/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:42.862485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317926b-007c-40a5-9bd9-09906fd14386 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:42.862769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317926b-007c-40a5-9bd9-09906fd14386 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:42.863087 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317926b-007c-40a5-9bd9-09906fd14386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:42.918523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-6317926b-007c-40a5-9bd9-09906fd14386 None None] MFA Rules not processed for user `3e5b4f84747844248092fe4ccfa41619`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:42.919915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6317926b-007c-40a5-9bd9-09906fd14386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:43.033147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 880/1758] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:43.044173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:43.057907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:43.227907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321ebf-cdc5-4d3a-93f2-a9433cad537a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:43.243691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40492f-73b6-437d-bf8d-ea8c39872d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:43.244549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40492f-73b6-437d-bf8d-ea8c39872d1b service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:43.247602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40492f-73b6-437d-bf8d-ea8c39872d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:43.250202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40492f-73b6-437d-bf8d-ea8c39872d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:43.261636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40492f-73b6-437d-bf8d-ea8c39872d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:43.263687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40492f-73b6-437d-bf8d-ea8c39872d1b service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:43.289858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 879/1759] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:43.429305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317926b-007c-40a5-9bd9-09906fd14386 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:43.439506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317926b-007c-40a5-9bd9-09906fd14386 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:43.443303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:43.444149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:43.444423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:43.444885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:43.506660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:43.508179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:43.520853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 881/1760] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:44.844102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9390d-fd2f-4b45-a3ad-8a92fadc5a18 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:44.845265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9390d-fd2f-4b45-a3ad-8a92fadc5a18 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:44.845852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9390d-fd2f-4b45-a3ad-8a92fadc5a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:44.888660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-00b9390d-fd2f-4b45-a3ad-8a92fadc5a18 None None] MFA Rules not processed for user `936d0f6110c64fb189e8ac21449da16e`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:44.890690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-00b9390d-fd2f-4b45-a3ad-8a92fadc5a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:44.994481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 880/1761] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:44.999729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:45.135738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f49ec-fa6a-4b5d-b4ab-01f287375b7f service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:45.142039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:45.142039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:45.143157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:45.143509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:45.144357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:45.146376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:45.457862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 882/1762] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:44 2022] POST /identity/v3/projects => generated 405 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:45.459008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9390d-fd2f-4b45-a3ad-8a92fadc5a18 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:45.478959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9390d-fd2f-4b45-a3ad-8a92fadc5a18 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:45.590570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:45.591505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:45.592032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:45.592956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:45.593796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:45.596207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:45.746036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 881/1763] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:45 2022] POST /identity/v3/users => generated 309 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:45.750830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:45.761606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73549a3f-dfb9-4111-aeb4-3dc1c6d071d2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:45.766756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:45.767530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:45.767789 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:45.768057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:45.768779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:45.770442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:45.785823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 883/1764] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:45.789751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:45.805535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285bcd-d1c3-4513-a335-f1309afb6c85 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:45.805740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:45.806636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:45.806957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:45.807352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] PATH_INFO: `/v3/projects/d869da75cebe4c3facc5366c2f0cc40a/users/9033f34a437045efabadf13170a12e8b/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:45.832683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d869da75cebe4c3facc5366c2f0cc40a, user_id=9033f34a437045efabadf13170a12e8b, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:45.835825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:45.914478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 882/1765] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:45 2022] PUT /identity/v3/projects/d869da75cebe4c3facc5366c2f0cc40a/users/9033f34a437045efabadf13170a12e8b/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:45.918759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:45.929380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caa168-1b50-4abe-a4a1-b7ff30f75dda admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:46.007817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:46.008680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:46.009180 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:46.009701 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:46.010536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:46.012642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:46.025284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 884/1766] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:46.029524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:46.042160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0cf4-b25e-4509-9821-b3389ae85304 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:46.047427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecb6c6-a75e-45f2-88d6-19816369c3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:46.048482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb6c6-a75e-45f2-88d6-19816369c3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:46.048778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb6c6-a75e-45f2-88d6-19816369c3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:46.049045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb6c6-a75e-45f2-88d6-19816369c3b5 admin admin] PATH_INFO: `/v3/projects/d869da75cebe4c3facc5366c2f0cc40a/users/9033f34a437045efabadf13170a12e8b/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:46.051226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecb6c6-a75e-45f2-88d6-19816369c3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d869da75cebe4c3facc5366c2f0cc40a, user_id=9033f34a437045efabadf13170a12e8b, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:46.053902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecb6c6-a75e-45f2-88d6-19816369c3b5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:46.065265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 883/1767] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:46 2022] PUT /identity/v3/projects/d869da75cebe4c3facc5366c2f0cc40a/users/9033f34a437045efabadf13170a12e8b/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:46.897207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:46.899950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:46.926277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397ff5-2d5b-4843-bdcf-13588cba7180 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:47.046095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:47.047913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:47.048382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:47.048851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] PATH_INFO: `/v3/users/f8b42bceee2e4d2995aa39a46857e3cb` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:47.050332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b42bceee2e4d2995aa39a46857e3cb)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:47.057929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:47.292778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b42bceee2e4d2995aa39a46857e3cb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:47.292778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b42bceee2e4d2995aa39a46857e3cb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:47.329725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b42bceee2e4d2995aa39a46857e3cb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:47.352068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b42bceee2e4d2995aa39a46857e3cb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:47.457773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b42bceee2e4d2995aa39a46857e3cb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:47.464791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 885/1768] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:46 2022] DELETE /identity/v3/users/f8b42bceee2e4d2995aa39a46857e3cb => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:47.469890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2257b-2bc3-4fc0-9c59-4be5c26abce4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:47.470417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2257b-2bc3-4fc0-9c59-4be5c26abce4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:47.470417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2257b-2bc3-4fc0-9c59-4be5c26abce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:47.491642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-61d2257b-2bc3-4fc0-9c59-4be5c26abce4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:47.493189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-61d2257b-2bc3-4fc0-9c59-4be5c26abce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:47.575845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 884/1769] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:47.583948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:47.585485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:47.610551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:47.611230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:47.611775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:47.646550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] MFA Rules not processed for user `9033f34a437045efabadf13170a12e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:47.650285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:47.692516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f289-a2f7-4e66-9bd7-891c7899ea32 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:47.700545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:47.700545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:47.700545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:47.700545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:47.731484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:47.731484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:47.765962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 886/1770] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:47.845083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 885/1771] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:48.242656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:48.245289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:48.285032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179b69a-d4fa-4541-8a45-ce68010c1db5 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:48.297613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:48.299405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:48.299893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:48.300519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] PATH_INFO: `/v3/users/dd60bb2f0c88443eb7a38df99804eed0` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:48.302973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd60bb2f0c88443eb7a38df99804eed0)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:48.305356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:49.204361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd60bb2f0c88443eb7a38df99804eed0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.205199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd60bb2f0c88443eb7a38df99804eed0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.221833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:49.224122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:49.252773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbfb44-579d-417f-a992-1bc16c6e0ce3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:49.254621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd60bb2f0c88443eb7a38df99804eed0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.264754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd60bb2f0c88443eb7a38df99804eed0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.268852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:49.269985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:49.270492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:49.271045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] PATH_INFO: `/v3/projects/5d744e5fde824907b30fc07b6482bfe2` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:49.272432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d744e5fde824907b30fc07b6482bfe2)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:49.274642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:49.361478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-25156e30-ad6d-4ea9-b5fa-7af6b9d09ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd60bb2f0c88443eb7a38df99804eed0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.397845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 887/1772] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:48 2022] DELETE /identity/v3/users/dd60bb2f0c88443eb7a38df99804eed0 => generated 0 bytes in 1155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:49.402510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004f85-e981-4b3f-8653-c288098af8bd None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:49.403133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004f85-e981-4b3f-8653-c288098af8bd None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:49.403627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004f85-e981-4b3f-8653-c288098af8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:49.434265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-81004f85-e981-4b3f-8653-c288098af8bd None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:49.435669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-81004f85-e981-4b3f-8653-c288098af8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:49.460915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d744e5fde824907b30fc07b6482bfe2', 'request_id': 'req-c991ad2d-8223-427c-859e-f00b22a04af8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.549046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d744e5fde824907b30fc07b6482bfe2', 'request_id': 'req-c991ad2d-8223-427c-859e-f00b22a04af8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.558910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d744e5fde824907b30fc07b6482bfe2', 'request_id': 'req-c991ad2d-8223-427c-859e-f00b22a04af8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.578756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 888/1773] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:49.588847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] The token cache is being invalidate because project 5d744e5fde824907b30fc07b6482bfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:49.591206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.593140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:49.597515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 886/1774] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:49 2022] DELETE /identity/v3/projects/5d744e5fde824907b30fc07b6482bfe2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:49.603325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840de1fe-244b-4bec-9000-057193782214 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:49.603677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840de1fe-244b-4bec-9000-057193782214 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:49.604017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840de1fe-244b-4bec-9000-057193782214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:49.624626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:49.626778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:49.649521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-840de1fe-244b-4bec-9000-057193782214 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:49.651094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-840de1fe-244b-4bec-9000-057193782214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:49.725421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991ad2d-8223-427c-859e-f00b22a04af8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:49.737243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:49.749102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:49.749102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:49.749102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:49.749349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 889/1775] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:49.749426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:49.749508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5741d-7474-47e2-9548-d989d5e52f37 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:49.749508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5741d-7474-47e2-9548-d989d5e52f37 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:49.749508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5741d-7474-47e2-9548-d989d5e52f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:49.770554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:49.774324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:49.790656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 887/1776] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:45:49.805757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-94a5741d-7474-47e2-9548-d989d5e52f37 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:49.806883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-94a5741d-7474-47e2-9548-d989d5e52f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:49.819210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 890/1777] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:49.820993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:49.833024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df341ff0-98bc-4d27-9c41-719def5c6eba service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:49.838160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:49.838929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:49.839515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:49.839515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:49.840519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:49.840833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:49.843263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:49.861118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 888/1778] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:49.868015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5741d-7474-47e2-9548-d989d5e52f37 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:49.884483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5741d-7474-47e2-9548-d989d5e52f37 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:49.894426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:49.895136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:49.903926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:49.903926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:49.904248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:49.906677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.073026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 891/1779] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:49 2022] POST /identity/v3/projects => generated 355 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:45:50.077882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.094175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656785-56f5-4270-915e-961f01699766 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.194141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.194836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.195124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.195398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.199293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.199293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.320743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 889/1780] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:50 2022] POST /identity/v3/users => generated 278 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:45:50.322015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.335745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754dc0f-6fd5-4c6f-b648-7fa822033351 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.340910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.342873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.342873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.342873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.343154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.345122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.349425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.351755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:50.360004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 892/1781] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:50.366222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c81ea5-9855-4d8d-a2d1-deda658e4688 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.370513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.373136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.374953 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.375256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.375624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] PATH_INFO: `/v3/users/f5f45e0cc96d47ddaeb0f9cfc10445ac` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.376944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f45e0cc96d47ddaeb0f9cfc10445ac)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.378962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.381610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cefc1-bbbc-473c-9b46-315dc590e617 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.386122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.386759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.387077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.387991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.388732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.390540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.404124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 893/1782] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:45:50.405156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.416097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4eb043-3392-4799-b8ee-295553e24a5a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.420863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.421825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.422135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.422408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] PATH_INFO: `/v3/projects/56198b7071d7441e96e3efdc9772c1da/users/936c9016c87f4a4fa79bba2daf1b4f9c/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.439619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56198b7071d7441e96e3efdc9772c1da, user_id=936c9016c87f4a4fa79bba2daf1b4f9c, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.445192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.530924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 894/1783] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:50 2022] PUT /identity/v3/projects/56198b7071d7441e96e3efdc9772c1da/users/936c9016c87f4a4fa79bba2daf1b4f9c/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:50.532224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.534073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:50.568049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f45e0cc96d47ddaeb0f9cfc10445ac'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.605377 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744cf36a-5cc7-4820-bbf4-17f8119bccc1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.610858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.614949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.614949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.614949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] PATH_INFO: `/v3/projects/fe5722a33cc64c83bdb7dc1bf4bd02b4` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.614949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5722a33cc64c83bdb7dc1bf4bd02b4)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.615429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.635568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f45e0cc96d47ddaeb0f9cfc10445ac'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.636744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f45e0cc96d47ddaeb0f9cfc10445ac'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.637733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f45e0cc96d47ddaeb0f9cfc10445ac'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.648406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8c1c3a5a-6542-4b02-83f7-9d61857d5057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f45e0cc96d47ddaeb0f9cfc10445ac'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.668336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 890/1784] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:50 2022] DELETE /identity/v3/users/f5f45e0cc96d47ddaeb0f9cfc10445ac => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:50.674601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf79414-eb44-4257-8032-5957e3b15cdc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.674601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf79414-eb44-4257-8032-5957e3b15cdc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.674601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf79414-eb44-4257-8032-5957e3b15cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.701607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-baf79414-eb44-4257-8032-5957e3b15cdc None None] MFA Rules not processed for user `936c9016c87f4a4fa79bba2daf1b4f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:50.707165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-baf79414-eb44-4257-8032-5957e3b15cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:50.769940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 891/1785] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:50.771297 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.771587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.771863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.789155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:50.790431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:50.792049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5722a33cc64c83bdb7dc1bf4bd02b4', 'request_id': 'req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.798468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5722a33cc64c83bdb7dc1bf4bd02b4', 'request_id': 'req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.847692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 892/1786] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:50.848533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.849789 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:50.861852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44068dd-3e2f-463d-b0e0-3767e3b800d5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.866415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.867289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.867572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.867847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] PATH_INFO: `/v3/users/936d0f6110c64fb189e8ac21449da16e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.869046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=936d0f6110c64fb189e8ac21449da16e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.870998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:50.911052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5722a33cc64c83bdb7dc1bf4bd02b4', 'request_id': 'req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.923625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] The token cache is being invalidate because project fe5722a33cc64c83bdb7dc1bf4bd02b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:50.923912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.924568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:50.926244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 895/1787] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:50 2022] DELETE /identity/v3/projects/fe5722a33cc64c83bdb7dc1bf4bd02b4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:50.927115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:50.928420 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:50.944128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2f755-05d3-4b83-b7c1-c2b4a04f627f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:50.948861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:50.949511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:50.950898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:50.950898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:50.950898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:50.953208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.036663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 896/1788] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:50 2022] POST /identity/v3/projects => generated 357 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:51.040475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.042065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.070153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936d0f6110c64fb189e8ac21449da16e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.099088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f7848-e4ad-44ff-8f66-3410406b6f8f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.102723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.103389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.103672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.103946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.105710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.143098 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936d0f6110c64fb189e8ac21449da16e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.143773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936d0f6110c64fb189e8ac21449da16e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.144497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936d0f6110c64fb189e8ac21449da16e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.151871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936d0f6110c64fb189e8ac21449da16e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.167658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.169117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.169302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 893/1789] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:50 2022] DELETE /identity/v3/users/936d0f6110c64fb189e8ac21449da16e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:51.170113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.171596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.179839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 897/1790] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:51.180728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.189783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbc4fe-ccef-4084-8208-c02b76d323c4 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.255554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.256585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.257453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.257898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.258722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.261328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.265113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833a10d-3f02-4b94-afa5-333a0c74c7ec admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.271153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.273554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.273554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.273554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] PATH_INFO: `/v3/users/3e5b4f84747844248092fe4ccfa41619` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.275177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5b4f84747844248092fe4ccfa41619)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.277350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.372149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 898/1791] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:51 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:51.376630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.378315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.390846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1328f9-405f-44c4-bb74-ba2ffb27de60 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.395819 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.396416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.396701 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.396977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.397729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.399370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.409645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 899/1792] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:45:51.413635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.423953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad906a5f-744d-42ee-8ad9-48be283b499f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.428699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.432619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.432619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.432619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] PATH_INFO: `/v3/projects/49d3ef268ee94ff7b886f7072823c161/users/7d261e877d5b4ab08e1ead39c603c2eb/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.447163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d3ef268ee94ff7b886f7072823c161, user_id=7d261e877d5b4ab08e1ead39c603c2eb, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.449892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.495527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5b4f84747844248092fe4ccfa41619'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.550236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 900/1793] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:51 2022] PUT /identity/v3/projects/49d3ef268ee94ff7b886f7072823c161/users/7d261e877d5b4ab08e1ead39c603c2eb/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:45:51.550236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.550236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.565996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5b4f84747844248092fe4ccfa41619'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.566673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5b4f84747844248092fe4ccfa41619'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.567371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5b4f84747844248092fe4ccfa41619'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.575237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5b4f84747844248092fe4ccfa41619'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.593828 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 894/1794] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:51 2022] DELETE /identity/v3/users/3e5b4f84747844248092fe4ccfa41619 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:51.597069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.598096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.623165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae7fca-9a48-4491-8473-7112878270f9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.688482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70168d-0815-4a9a-a113-4229b443cb6a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.693326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.694067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.694422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.694760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.695930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.697524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.703780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.704274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.704558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.705463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] PATH_INFO: `/v3/projects/8650f4719642413691a8dbe3746b2db4` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.707602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8650f4719642413691a8dbe3746b2db4)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.709715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.709932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 895/1795] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:51.710764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.713840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.726657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598da2-9344-4e0c-af44-a43e903e31bd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:51.733541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:51.734561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:51.736162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:51.736162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] PATH_INFO: `/v3/projects/bd0b35e3f5cf47f2a248b1ddee48e0e9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:51.737168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0b35e3f5cf47f2a248b1ddee48e0e9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:51.739614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:51.834389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8650f4719642413691a8dbe3746b2db4', 'request_id': 'req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.839942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8650f4719642413691a8dbe3746b2db4', 'request_id': 'req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.879647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0b35e3f5cf47f2a248b1ddee48e0e9', 'request_id': 'req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.917468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8650f4719642413691a8dbe3746b2db4', 'request_id': 'req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.941752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] The token cache is being invalidate because project 8650f4719642413691a8dbe3746b2db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:51.941752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.941752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.941752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 901/1796] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:51 2022] DELETE /identity/v3/projects/8650f4719642413691a8dbe3746b2db4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:51.941752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:51.943430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:51.983080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0b35e3f5cf47f2a248b1ddee48e0e9', 'request_id': 'req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:51.989799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0b35e3f5cf47f2a248b1ddee48e0e9', 'request_id': 'req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.000654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] The token cache is being invalidate because project bd0b35e3f5cf47f2a248b1ddee48e0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:52.000942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.001597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.003409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 896/1797] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:51 2022] DELETE /identity/v3/projects/bd0b35e3f5cf47f2a248b1ddee48e0e9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:52.004214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:52.005628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.007038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc88ff-ff1c-4a38-8434-aa1ae0310107 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:52.066888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:52.067732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.068075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.068421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] PATH_INFO: `/v3/projects/49d3ef268ee94ff7b886f7072823c161/users/7d261e877d5b4ab08e1ead39c603c2eb/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.070506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d3ef268ee94ff7b886f7072823c161, user_id=7d261e877d5b4ab08e1ead39c603c2eb, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:52.073746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:52.077193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d5440-6da4-42b5-8f9e-75ccfdf7a5ae admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:52.089330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:52.090742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.091849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.093129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] PATH_INFO: `/v3/users/9033f34a437045efabadf13170a12e8b` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.096185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9033f34a437045efabadf13170a12e8b)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:52.098534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:52.113051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 902/1798] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:51 2022] PUT /identity/v3/projects/49d3ef268ee94ff7b886f7072823c161/users/7d261e877d5b4ab08e1ead39c603c2eb/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:52.113051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:52.113051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.183018 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb204cce-1f62-4b21-a680-9c8e599667d4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:52.188951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:52.191712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.191712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.191712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] PATH_INFO: `/v3/users/c72045842c614930858a235c6af9bd47` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.192078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c72045842c614930858a235c6af9bd47)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:52.193864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:52.305052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9033f34a437045efabadf13170a12e8b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.434669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9033f34a437045efabadf13170a12e8b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.435396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9033f34a437045efabadf13170a12e8b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.438243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9033f34a437045efabadf13170a12e8b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.443903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9033f34a437045efabadf13170a12e8b'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.461855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 897/1799] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:52 2022] DELETE /identity/v3/users/9033f34a437045efabadf13170a12e8b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:52.462818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:52.464422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.499231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c72045842c614930858a235c6af9bd47'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.500230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c72045842c614930858a235c6af9bd47'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.520751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c72045842c614930858a235c6af9bd47'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.530340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c72045842c614930858a235c6af9bd47'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.560696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9e133-065c-4092-a5b5-47e3210d9d96 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:52.566319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:52.567206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.567482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.567748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] PATH_INFO: `/v3/projects/034aa827401842beb00358f2638d0069` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.568935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=034aa827401842beb00358f2638d0069)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:52.570930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:52.600426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-358899e5-f256-481c-ba76-2df7fa7ee784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c72045842c614930858a235c6af9bd47'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.608717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 903/1800] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:45:52 2022] DELETE /identity/v3/users/c72045842c614930858a235c6af9bd47 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:52.610109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1b56-5318-4027-b61b-bbcfdefaaaac None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.610406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1b56-5318-4027-b61b-bbcfdefaaaac None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.610683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d1b56-5318-4027-b61b-bbcfdefaaaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.639458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ae6d1b56-5318-4027-b61b-bbcfdefaaaac None None] MFA Rules not processed for user `7d261e877d5b4ab08e1ead39c603c2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:52.640753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ae6d1b56-5318-4027-b61b-bbcfdefaaaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.714488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034aa827401842beb00358f2638d0069', 'request_id': 'req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.721419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 904/1801] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:52.723821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.723821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.723821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.747837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] MFA Rules not processed for user `889a6422677047b6a75d1480f156ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:52.749731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.802510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034aa827401842beb00358f2638d0069', 'request_id': 'req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.810683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034aa827401842beb00358f2638d0069', 'request_id': 'req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.821037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 905/1802] 10.222.0.31 () {58 vars in 1015 bytes} [Mon Jan 31 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:52.821937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:52.823550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.824218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] The token cache is being invalidate because project 034aa827401842beb00358f2638d0069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:52.824704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.825524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:52.827222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 898/1803] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:52 2022] DELETE /identity/v3/projects/034aa827401842beb00358f2638d0069 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:52.832371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:52.834246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.901555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae185-6c9e-45d1-a7f9-fc7ea0f74480 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:52.907669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8f402-f764-45e2-b3ec-6c343dc00ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:52.908398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f402-f764-45e2-b3ec-6c343dc00ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.908746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f402-f764-45e2-b3ec-6c343dc00ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.909084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8f402-f764-45e2-b3ec-6c343dc00ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.911166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-69d8f402-f764-45e2-b3ec-6c343dc00ea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:52.926220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f33bb-71bc-438b-ae0f-b7ae6b339aed admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:52.929538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:52.931733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:52.932170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:52.932603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] PATH_INFO: `/v3/projects/d869da75cebe4c3facc5366c2f0cc40a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:52.934139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d869da75cebe4c3facc5366c2f0cc40a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:52.936842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.007177 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f402-f764-45e2-b3ec-6c343dc00ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.008722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8f402-f764-45e2-b3ec-6c343dc00ea5 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.018407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 906/1804] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:52 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:53.020439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b98ac-3138-4082-aefc-c5a5a4deaaa3 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.020439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b98ac-3138-4082-aefc-c5a5a4deaaa3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.020439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b98ac-3138-4082-aefc-c5a5a4deaaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.039867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c56b98ac-3138-4082-aefc-c5a5a4deaaa3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:53.041313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c56b98ac-3138-4082-aefc-c5a5a4deaaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.051259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 907/1805] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:53.060145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.060561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.061093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.071595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd869da75cebe4c3facc5366c2f0cc40a', 'request_id': 'req-f1e55072-8654-432d-929c-89d9047a4acd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.079513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:53.080700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.159582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd869da75cebe4c3facc5366c2f0cc40a', 'request_id': 'req-f1e55072-8654-432d-929c-89d9047a4acd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.178491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 908/1806] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:45:53.179484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.180144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd869da75cebe4c3facc5366c2f0cc40a', 'request_id': 'req-f1e55072-8654-432d-929c-89d9047a4acd'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.181008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.202648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] The token cache is being invalidate because project d869da75cebe4c3facc5366c2f0cc40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:53.203262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.204309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.208549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 899/1807] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:52 2022] DELETE /identity/v3/projects/d869da75cebe4c3facc5366c2f0cc40a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:53.210045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.217496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.293122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49cee-e93d-4cb2-9df9-6675a67a5f44 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.293377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e55072-8654-432d-929c-89d9047a4acd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.297187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.297998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.298356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.298501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.298770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.299182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.299526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.299733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.300908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.301682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.311492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.311822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.312910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.313513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.321173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 900/1808] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:53.322057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.333021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 909/1809] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:53.334714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.335026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ec804-0320-4a8a-ac66-5fa3249348e7 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.337585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.339098 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d104efd-b0b9-4403-93b1-21c6258d47de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.339761 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104efd-b0b9-4403-93b1-21c6258d47de service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.340076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104efd-b0b9-4403-93b1-21c6258d47de service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.340352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104efd-b0b9-4403-93b1-21c6258d47de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.349891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d104efd-b0b9-4403-93b1-21c6258d47de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.351364 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d104efd-b0b9-4403-93b1-21c6258d47de service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.359657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 901/1810] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:53.360734 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991c80c-ab92-41dc-98c5-e32ab6257c2e service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.361140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193fc2b-619c-4aed-84fc-2f5ef393c7b8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.362540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193fc2b-619c-4aed-84fc-2f5ef393c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.362540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193fc2b-619c-4aed-84fc-2f5ef393c7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.370066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.371345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.371622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.371947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.372741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:53.373040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.374961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.387915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 910/1811] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:53.389355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.393299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f193fc2b-619c-4aed-84fc-2f5ef393c7b8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:53.394346 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.396014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f193fc2b-619c-4aed-84fc-2f5ef393c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.412769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 902/1812] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:53.412769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193fc2b-619c-4aed-84fc-2f5ef393c7b8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.425723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193fc2b-619c-4aed-84fc-2f5ef393c7b8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.431278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.432315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.432745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.433165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.434348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.437739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.526580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb52313-ada3-422f-824a-011c7bbd9411 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.532876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8202458-43d6-4cd5-8a52-863ab7128e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.533725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202458-43d6-4cd5-8a52-863ab7128e2f service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.534125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202458-43d6-4cd5-8a52-863ab7128e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.534696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202458-43d6-4cd5-8a52-863ab7128e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.536769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c8202458-43d6-4cd5-8a52-863ab7128e2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.555204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 903/1813] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:53.556434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.559137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.621866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8202458-43d6-4cd5-8a52-863ab7128e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.624198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8202458-43d6-4cd5-8a52-863ab7128e2f service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.649731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 911/1814] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:53.652248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2459d-53a7-40cc-876a-845145525728 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.653853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08d7e-3c6e-49db-b2c7-d5330f082201 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.657319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08d7e-3c6e-49db-b2c7-d5330f082201 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.657613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08d7e-3c6e-49db-b2c7-d5330f082201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.659938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.661134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.661541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.661910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] PATH_INFO: `/v3/projects/22e2be453e334f0f8edd59c70b3c9650` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.663351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e2be453e334f0f8edd59c70b3c9650)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.665482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.696595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-03b08d7e-3c6e-49db-b2c7-d5330f082201 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:53.698285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-03b08d7e-3c6e-49db-b2c7-d5330f082201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.709466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 912/1815] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:53.714600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08d7e-3c6e-49db-b2c7-d5330f082201 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.727229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08d7e-3c6e-49db-b2c7-d5330f082201 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.733541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.734091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.734975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.735330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.736482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.739423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.805048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e2be453e334f0f8edd59c70b3c9650', 'request_id': 'req-602b2d30-66c6-4275-9c90-8ad723ea5fa8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.832698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 913/1816] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/users => generated 304 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:53.833890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.846772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df9b51-5a84-4b44-8edf-450fd67fbd34 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.912183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e2be453e334f0f8edd59c70b3c9650', 'request_id': 'req-602b2d30-66c6-4275-9c90-8ad723ea5fa8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.921802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fec0d-db5f-4ece-952c-b2fcd0181708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.922712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fec0d-db5f-4ece-952c-b2fcd0181708 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.923157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fec0d-db5f-4ece-952c-b2fcd0181708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.923568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fec0d-db5f-4ece-952c-b2fcd0181708 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.923899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e2be453e334f0f8edd59c70b3c9650', 'request_id': 'req-602b2d30-66c6-4275-9c90-8ad723ea5fa8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.924708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fec0d-db5f-4ece-952c-b2fcd0181708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:53.925150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fec0d-db5f-4ece-952c-b2fcd0181708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.927277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fec0d-db5f-4ece-952c-b2fcd0181708 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.940197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] The token cache is being invalidate because project 22e2be453e334f0f8edd59c70b3c9650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:45:53.940664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.942074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:45:53.944725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 904/1817] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:45:53 2022] DELETE /identity/v3/projects/22e2be453e334f0f8edd59c70b3c9650 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:53.947274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 914/1818] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:53.949599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:53.951256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.952482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.952939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.953362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.971226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b2d30-66c6-4275-9c90-8ad723ea5fa8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:53.987610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbfa13-09f0-497c-b378-0be370c298e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:53.987701 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:53.987773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfa13-09f0-497c-b378-0be370c298e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:53.987773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfa13-09f0-497c-b378-0be370c298e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:53.987773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfa13-09f0-497c-b378-0be370c298e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:53.987773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbfa13-09f0-497c-b378-0be370c298e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:53.987998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:53.990250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbfa13-09f0-497c-b378-0be370c298e6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:53.996947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 915/1819] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:53.998102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.001100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:54.014903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 905/1820] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:54.018618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be63bed-c6c9-414a-91ec-ff59f02c8d75 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.020861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be63bed-c6c9-414a-91ec-ff59f02c8d75 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.021179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be63bed-c6c9-414a-91ec-ff59f02c8d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.026866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01949d-c40f-438f-9d34-bfe3de9de69c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.037773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.041807 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.042092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.042365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.043104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.050739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.068525 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8be63bed-c6c9-414a-91ec-ff59f02c8d75 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:54.069311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8be63bed-c6c9-414a-91ec-ff59f02c8d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:54.084040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 906/1821] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:54.084880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be63bed-c6c9-414a-91ec-ff59f02c8d75 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.097570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be63bed-c6c9-414a-91ec-ff59f02c8d75 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.103710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.104425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.104709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.104980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.105721 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.107347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.121861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 907/1822] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:54.122749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.148040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf9af0-6bf0-4eb2-93f1-04c7d9b0559d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.150900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 916/1823] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:53 2022] POST /identity/v3/projects => generated 401 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:54.152556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.231815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.232460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.233345 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.233636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.234526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:45:54.234689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.237562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.254878 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 908/1824] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:45:54.256713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c96001-0a19-4d1f-98aa-4f32ae22d2e4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.257293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.272604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.273695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.273989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.274237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] PATH_INFO: `/v3/projects/103398c60ede4b46b245126d59bd83f3/users/a4b73dedb768446494532b70c78adf0a/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.281280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bee2f-c036-4d64-b79e-f0cac113b0b0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.288446 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede16e0-9327-4fcb-81dc-66f7c4e3417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.293655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede16e0-9327-4fcb-81dc-66f7c4e3417d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.293655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede16e0-9327-4fcb-81dc-66f7c4e3417d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.293655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede16e0-9327-4fcb-81dc-66f7c4e3417d admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.293655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede16e0-9327-4fcb-81dc-66f7c4e3417d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.293655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede16e0-9327-4fcb-81dc-66f7c4e3417d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.298411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=103398c60ede4b46b245126d59bd83f3, user_id=a4b73dedb768446494532b70c78adf0a, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.301476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.376974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 917/1825] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:54 2022] PUT /identity/v3/projects/103398c60ede4b46b245126d59bd83f3/users/a4b73dedb768446494532b70c78adf0a/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:54.387640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.455755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 909/1826] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:54 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:54.458509 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1072-1a96-4300-aec6-1e8752eef779 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.461140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1072-1a96-4300-aec6-1e8752eef779 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.461628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f1072-1a96-4300-aec6-1e8752eef779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.477337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da53d5e-ef7e-47e5-8250-0d5e1b5a1d4a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.491138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.492193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.492892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.494161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.495200 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.499190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.501167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-254f1072-1a96-4300-aec6-1e8752eef779 None None] MFA Rules not processed for user `a4b73dedb768446494532b70c78adf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:54.502500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-254f1072-1a96-4300-aec6-1e8752eef779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:54.579742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 910/1827] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:54.580451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1072-1a96-4300-aec6-1e8752eef779 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.594255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f1072-1a96-4300-aec6-1e8752eef779 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.600673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.600808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 918/1828] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:54 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:54.601950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.601950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.601950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.602710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.604171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.604790 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.629043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 911/1829] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:54.629930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.640523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209445eb-51a8-4594-a3df-5defbfc73e13 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.704205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.705128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.705339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.705630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.706311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082053-33b1-49d4-9edf-975e98f00038 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.706433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.708979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.721722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.723369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.723657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.724025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.725263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.726857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.790781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 912/1830] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:54 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:54.790781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.801055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dd626-7a88-4bf3-a7a5-47de7a12f312 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.809736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.811132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.811411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.811763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.812576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.814026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.824659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 913/1831] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:54.825319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.837607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 919/1832] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:54 2022] POST /identity/v3/projects => generated 407 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:54.839899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.862160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f8280-babd-48d7-b992-a484732fcf01 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.916871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29abd-229d-413b-8aa4-fddf9a8210b8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:54.923128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.924100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.924383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.924656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] PATH_INFO: `/v3/projects/a1d189405ec74b20bd5075a71feca20a/users/6ec40c4cb8934d96824efa9b366edb4e/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.941233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d189405ec74b20bd5075a71feca20a, user_id=6ec40c4cb8934d96824efa9b366edb4e, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.944454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.971904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:54.972579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:54.972874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:54.973127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:54.973972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:54.975516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:54.985920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 914/1833] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:54.986902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:54.999427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94fbe7-19af-4067-99ba-cc596e4f67fe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:55.005545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703c431-45f9-44db-8390-82210699a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:55.006290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703c431-45f9-44db-8390-82210699a602 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.006633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703c431-45f9-44db-8390-82210699a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.007002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703c431-45f9-44db-8390-82210699a602 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.008547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703c431-45f9-44db-8390-82210699a602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:55.010538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703c431-45f9-44db-8390-82210699a602 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:55.046691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 920/1834] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:54 2022] PUT /identity/v3/projects/a1d189405ec74b20bd5075a71feca20a/users/6ec40c4cb8934d96824efa9b366edb4e/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:55.047725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:55.134551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 915/1835] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:54 2022] POST /identity/v3/users => generated 310 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:55.136008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c93ea-4d4e-454f-af8b-0c00bf63186b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.136299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c93ea-4d4e-454f-af8b-0c00bf63186b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.136599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c93ea-4d4e-454f-af8b-0c00bf63186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.140381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3090-58e1-44a8-aecc-ec411a6aacbb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:55.157623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:55.158388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.158649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.158955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.164103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:55.164103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:55.188153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 921/1836] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:55.189101 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:55.214010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fc9c93ea-4d4e-454f-af8b-0c00bf63186b None None] MFA Rules not processed for user `6ec40c4cb8934d96824efa9b366edb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:55.219770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fc9c93ea-4d4e-454f-af8b-0c00bf63186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:55.241593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbbb62-b51c-4e0f-95a0-427df43c2494 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:55.256167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:55.256867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.257165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.257534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.258341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:55.261540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:55.289174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 922/1837] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:55.289174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:55.319048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46fcae-6714-4094-95d9-535643caf33e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:55.329684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:55.331129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.331673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.332509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] PATH_INFO: `/v3/projects/fcde70f16b77430cb000fd431908c79d/users/83494d2fb25f42098ed3094540562f3b/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.353603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcde70f16b77430cb000fd431908c79d, user_id=83494d2fb25f42098ed3094540562f3b, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:55.357016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:55.384090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 916/1838] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:55.384090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ad77-4d15-46ae-a94e-823c8688c87f None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.384090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ad77-4d15-46ae-a94e-823c8688c87f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.384090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31ad77-4d15-46ae-a94e-823c8688c87f None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.389478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 917/1839] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:45:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:45:55.391075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ad77-4d15-46ae-a94e-823c8688c87f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:55.406978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31ad77-4d15-46ae-a94e-823c8688c87f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:55.412177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23948de-7ff0-43a2-aebe-d7385f5c3378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:55.416690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23948de-7ff0-43a2-aebe-d7385f5c3378 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.416690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23948de-7ff0-43a2-aebe-d7385f5c3378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.416690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23948de-7ff0-43a2-aebe-d7385f5c3378 admin admin] PATH_INFO: `/v3/projects/e54c770638304489968a927ff619c9c4/users/77f1c9c299ea4b038cd62a19b1e49bec/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.432506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23948de-7ff0-43a2-aebe-d7385f5c3378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54c770638304489968a927ff619c9c4, user_id=77f1c9c299ea4b038cd62a19b1e49bec, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:55.435781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23948de-7ff0-43a2-aebe-d7385f5c3378 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:55.492010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 923/1840] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:55 2022] PUT /identity/v3/projects/fcde70f16b77430cb000fd431908c79d/users/83494d2fb25f42098ed3094540562f3b/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:55.493480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:55.544816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 918/1841] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:55 2022] PUT /identity/v3/projects/e54c770638304489968a927ff619c9c4/users/77f1c9c299ea4b038cd62a19b1e49bec/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:55.547701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138809-21f7-4506-9f4d-90a3ab20dabc None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.549555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138809-21f7-4506-9f4d-90a3ab20dabc None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.550213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14138809-21f7-4506-9f4d-90a3ab20dabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.578715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ec65d-b302-4637-8f90-17d326e5b12b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:55.642182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-14138809-21f7-4506-9f4d-90a3ab20dabc None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:55.650485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-14138809-21f7-4506-9f4d-90a3ab20dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:55.775342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:55.775956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.776241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.776600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.778131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:55.781319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:55.807890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 919/1842] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:55.810022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5511ed9-7206-4644-a1e6-9c969fbf2f0c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:55.811496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5511ed9-7206-4644-a1e6-9c969fbf2f0c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:55.811974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5511ed9-7206-4644-a1e6-9c969fbf2f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:55.855666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b5511ed9-7206-4644-a1e6-9c969fbf2f0c None None] MFA Rules not processed for user `83494d2fb25f42098ed3094540562f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:55.856548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b5511ed9-7206-4644-a1e6-9c969fbf2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:55.916079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 924/1843] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:55 2022] POST /identity/v3/projects => generated 399 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:55.917070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:55.949458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 920/1844] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:55.950953 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5511ed9-7206-4644-a1e6-9c969fbf2f0c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:55.968636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5511ed9-7206-4644-a1e6-9c969fbf2f0c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.031775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32213c93-1055-4062-a086-4024325cf28b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.037549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.039037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.039201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.039458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.040293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.042008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.055724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 925/1845] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:56.057261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364e2bc-8664-4383-9119-9a3352f704fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.057755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.058334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e2bc-8664-4383-9119-9a3352f704fb admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.059572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e2bc-8664-4383-9119-9a3352f704fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.060036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364e2bc-8664-4383-9119-9a3352f704fb admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.061589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e2bc-8664-4383-9119-9a3352f704fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.064321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5364e2bc-8664-4383-9119-9a3352f704fb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.072662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc973209-6f57-45a3-baee-a8871b25515a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.084568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.085290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.085574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.085843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.086551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.089208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.191786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 921/1846] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:55 2022] POST /identity/v3/users => generated 306 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:56.193742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261fbfd-ce7b-412e-92fb-1aa0971fea58 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.194273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261fbfd-ce7b-412e-92fb-1aa0971fea58 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.194877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261fbfd-ce7b-412e-92fb-1aa0971fea58 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.197678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 922/1847] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:45:56.198687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261fbfd-ce7b-412e-92fb-1aa0971fea58 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.214165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261fbfd-ce7b-412e-92fb-1aa0971fea58 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.219702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.220696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.221045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.221443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] PATH_INFO: `/v3/projects/e54c770638304489968a927ff619c9c4/users/77f1c9c299ea4b038cd62a19b1e49bec/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.223645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54c770638304489968a927ff619c9c4, user_id=77f1c9c299ea4b038cd62a19b1e49bec, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.226096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 926/1848] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:45:56 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:56.226096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.228886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.234296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:56.247924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 923/1849] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:56 2022] PUT /identity/v3/projects/e54c770638304489968a927ff619c9c4/users/77f1c9c299ea4b038cd62a19b1e49bec/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:56.252038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.324408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01483368-d675-4a8a-87ac-70fdfbca2dae admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.346773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a221d50-5fcb-4afd-9e40-db66a048dcb8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.352492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.353905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.354559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.355020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.355931 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.358229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.374926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 924/1850] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:56.377635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.402427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7ed78-92b0-4837-9892-209dbe7a46a2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.403644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3c1a5-4bf7-4399-9d07-c69bbc28f5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.404538 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c1a5-4bf7-4399-9d07-c69bbc28f5d4 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.405046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c1a5-4bf7-4399-9d07-c69bbc28f5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.405299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3c1a5-4bf7-4399-9d07-c69bbc28f5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.409253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.410173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.411631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.412113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.413014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.415165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.418144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3c1a5-4bf7-4399-9d07-c69bbc28f5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.422246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3c1a5-4bf7-4399-9d07-c69bbc28f5d4 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.437791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 927/1851] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:56.439379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de42f-e8d7-4d08-bc07-d5e3ae5f1fd3 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.439663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de42f-e8d7-4d08-bc07-d5e3ae5f1fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.439993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de42f-e8d7-4d08-bc07-d5e3ae5f1fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.472083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f30de42f-e8d7-4d08-bc07-d5e3ae5f1fd3 None None] MFA Rules not processed for user `77f1c9c299ea4b038cd62a19b1e49bec`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:56.474288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f30de42f-e8d7-4d08-bc07-d5e3ae5f1fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:56.532438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 925/1852] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:45:56 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:45:56.536824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.570550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d17b0a-dad1-42f0-b3e6-49c86bd88ea6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.584407 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.587791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.587791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.587791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] PATH_INFO: `/v3/projects/36cd3a54306047ee8d32b5693e5958fb/users/d3f6939b7b044738b79d0c59a82be190/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.588062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 928/1853] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:56.589253 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b026-aa0c-4869-be28-2be1927be508 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.589529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b026-aa0c-4869-be28-2be1927be508 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.589803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b026-aa0c-4869-be28-2be1927be508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.609043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cd3a54306047ee8d32b5693e5958fb, user_id=d3f6939b7b044738b79d0c59a82be190, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.612010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.632900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c699b026-aa0c-4869-be28-2be1927be508 None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:56.636071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c699b026-aa0c-4869-be28-2be1927be508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:56.647799 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 929/1854] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:45:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:56.648782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699b026-aa0c-4869-be28-2be1927be508 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.661925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699b026-aa0c-4869-be28-2be1927be508 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.667191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.668206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.668550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.668883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.670745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.674071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.692784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 930/1855] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:56.701477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 926/1856] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:56 2022] PUT /identity/v3/projects/36cd3a54306047ee8d32b5693e5958fb/users/d3f6939b7b044738b79d0c59a82be190/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:56.703949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.705985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:56.708748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:56.854943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4955955-cd01-4fd8-af82-c9865f050bb3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.867226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.868999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.868999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.883465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb8931-fb79-4db3-87f7-205bf63d79c1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:56.883942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] PATH_INFO: `/v3/projects/aebb99bc596848ad9cf93a19254e8a25/users/0c6cf9b35c7c4218953a1dbdc1dbe87d/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:56.902697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebb99bc596848ad9cf93a19254e8a25, user_id=0c6cf9b35c7c4218953a1dbdc1dbe87d, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:56.907235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:56.942711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:56.943637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:56.948666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:56.948666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.056172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 927/1857] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:56 2022] PUT /identity/v3/projects/aebb99bc596848ad9cf93a19254e8a25/users/0c6cf9b35c7c4218953a1dbdc1dbe87d/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:57.057277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:57.061364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:57.063078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:57.102993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 931/1858] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:57.104178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:57.119618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153439de-b2ac-49f3-ba1d-be7d881c6650 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:57.205846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a655079-3f9e-4b4c-bb8b-bb17d5a86200 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:57.226288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:57.228610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.228873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.229155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.229995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:57.231854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:57.275604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 928/1859] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:57.276558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:57.293322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:57.294541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.294988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.295695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.298100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:57.300415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:57.317697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 932/1860] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:45:57.318920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:57.330590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b139ab8-b11d-4d87-b3c0-178092138fc2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:57.336071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:57.337072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.338045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.338045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] PATH_INFO: `/v3/projects/36cd3a54306047ee8d32b5693e5958fb/users/d3f6939b7b044738b79d0c59a82be190/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.340786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cd3a54306047ee8d32b5693e5958fb, user_id=d3f6939b7b044738b79d0c59a82be190, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:57.344927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:57.382860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 933/1861] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:57 2022] PUT /identity/v3/projects/36cd3a54306047ee8d32b5693e5958fb/users/d3f6939b7b044738b79d0c59a82be190/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:57.382860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:57.433825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8b63b-ec8c-4d21-81c2-104938a7b412 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:57.504958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a9653-e478-4d2e-8d66-7c573c8da5c7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:57.521488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5d33-4711-4237-afb5-7075a9769a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:57.524117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5d33-4711-4237-afb5-7075a9769a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.524598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5d33-4711-4237-afb5-7075a9769a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.526401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5d33-4711-4237-afb5-7075a9769a9b admin admin] PATH_INFO: `/v3/projects/aebb99bc596848ad9cf93a19254e8a25/users/0c6cf9b35c7c4218953a1dbdc1dbe87d/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.530718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5d33-4711-4237-afb5-7075a9769a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebb99bc596848ad9cf93a19254e8a25, user_id=0c6cf9b35c7c4218953a1dbdc1dbe87d, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:57.535074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5d33-4711-4237-afb5-7075a9769a9b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:57.565041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 934/1862] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:45:57 2022] PUT /identity/v3/projects/aebb99bc596848ad9cf93a19254e8a25/users/0c6cf9b35c7c4218953a1dbdc1dbe87d/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:45:57.566943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db1d7-f2c8-44b9-8429-5efc5a33b3e1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.567470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db1d7-f2c8-44b9-8429-5efc5a33b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.567938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db1d7-f2c8-44b9-8429-5efc5a33b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.599998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefeebb-c0ac-4c61-8321-575a2f6f4bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:57.600753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefeebb-c0ac-4c61-8321-575a2f6f4bcc service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.601025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefeebb-c0ac-4c61-8321-575a2f6f4bcc service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.602001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefeebb-c0ac-4c61-8321-575a2f6f4bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.632228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefeebb-c0ac-4c61-8321-575a2f6f4bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:57.634265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-4b2db1d7-f2c8-44b9-8429-5efc5a33b3e1 None None] MFA Rules not processed for user `d3f6939b7b044738b79d0c59a82be190`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:57.634698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefeebb-c0ac-4c61-8321-575a2f6f4bcc service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:57.636937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4b2db1d7-f2c8-44b9-8429-5efc5a33b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:57.676217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 929/1863] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:57.679780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.680115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.680357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:57.752274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] MFA Rules not processed for user `0c6cf9b35c7c4218953a1dbdc1dbe87d`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:45:57.753764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:57.842584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 935/1864] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:57.844434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2db1d7-f2c8-44b9-8429-5efc5a33b3e1 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:57.925111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 930/1865] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:45:57.926328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:57.927814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:45:57.961407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2db1d7-f2c8-44b9-8429-5efc5a33b3e1 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:57.971592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:57.972524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:57.973004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:57.973354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:58.041635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00654c17-f1f7-4289-b091-cb1dd1579866 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:58.055124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:58.055876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:58.056159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:58.056433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:58.080810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:58.082309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:58.096020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 931/1866] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:58.118451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:58.120152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:58.139665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 936/1867] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:58.189701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:58.199214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74ec1f-01b8-42e6-b890-a65f060d2ed1 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:58.209108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:58.211219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:58.212928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:58.213202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:58.336047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:58.337911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:58.348403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 932/1868] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:45:59.004067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:45:59.011201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd828-e6bc-4c26-8ac5-d3ea19b1423a service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:45:59.016667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:45:59.017328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:45:59.017613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:45:59.017891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:45:59.109106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:45:59.110947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:45:59.138155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 937/1869] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:45:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:11.136839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:11.149675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31c7f1-3ffa-4b86-91a4-80a588088d2f service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:11.161059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99ade3-8d7e-437c-ab1a-cc983aff712c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:11.163217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ade3-8d7e-437c-ab1a-cc983aff712c service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:11.165058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ade3-8d7e-437c-ab1a-cc983aff712c service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:11.165901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99ade3-8d7e-437c-ab1a-cc983aff712c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:11.194079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99ade3-8d7e-437c-ab1a-cc983aff712c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:11.196872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99ade3-8d7e-437c-ab1a-cc983aff712c service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:11.221492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 933/1870] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:12.101217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:12.165440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605154c-bb99-4fec-9abd-41a578de3ad9 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:12.170016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:12.170895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:12.171461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:12.171998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] PATH_INFO: `/v3/users/6ec40c4cb8934d96824efa9b366edb4e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:12.173201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec40c4cb8934d96824efa9b366edb4e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:12.175167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:12.399736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4266-c2ee-4e08-8c92-5bacd2fb62a7 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:12.400300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4266-c2ee-4e08-8c92-5bacd2fb62a7 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:12.400638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b4266-c2ee-4e08-8c92-5bacd2fb62a7 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:12.402849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 934/1871] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:46:12.409338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1295-2791-4fe3-80ac-fdad31484543 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:12.410336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1295-2791-4fe3-80ac-fdad31484543 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:12.410904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1295-2791-4fe3-80ac-fdad31484543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:12.435317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2e5a1295-2791-4fe3-80ac-fdad31484543 None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:12.437464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2e5a1295-2791-4fe3-80ac-fdad31484543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:12.440411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec40c4cb8934d96824efa9b366edb4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:12.441406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec40c4cb8934d96824efa9b366edb4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:12.455151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec40c4cb8934d96824efa9b366edb4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:12.466925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec40c4cb8934d96824efa9b366edb4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:12.510666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 935/1872] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:46:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:12.523217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a1295-2791-4fe3-80ac-fdad31484543 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:12.527781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65de16a5-cb29-48cb-87db-0ece8b495a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec40c4cb8934d96824efa9b366edb4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:12.534555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a1295-2791-4fe3-80ac-fdad31484543 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:12.535837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 938/1873] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:12 2022] DELETE /identity/v3/users/6ec40c4cb8934d96824efa9b366edb4e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:12.541476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:12.541728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:12.542009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:12.559546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:12.561136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:12.600905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:12.601552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:12.601835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:12.602108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:12.603960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:12.616792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:12.618477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:12.623885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 939/1874] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:12.630468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 936/1875] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:46:12.632196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:12.633627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:12.693965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324848-5cce-4599-aff7-91644612c2eb None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:12.698063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:12.698724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:12.699031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:12.699302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:12.709218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:12.710657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:12.720380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 940/1876] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:13.152064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:13.153495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:13.167672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e1f7e-0932-457b-b8fe-551cccbb35db service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:13.173278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:13.174121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:13.174404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:13.174679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] PATH_INFO: `/v3/projects/a1d189405ec74b20bd5075a71feca20a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:13.175941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d189405ec74b20bd5075a71feca20a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:13.177914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:13.342603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d189405ec74b20bd5075a71feca20a', 'request_id': 'req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.468548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d189405ec74b20bd5075a71feca20a', 'request_id': 'req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.478521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d189405ec74b20bd5075a71feca20a', 'request_id': 'req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.490777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] The token cache is being invalidate because project a1d189405ec74b20bd5075a71feca20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:13.491102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.495344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.495344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 937/1877] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:13 2022] DELETE /identity/v3/projects/a1d189405ec74b20bd5075a71feca20a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:13.497556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:13.508459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941254d4-815a-4631-9912-0116ff986aad service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:13.587331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:13.588216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:13.588496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:13.588768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] PATH_INFO: `/v3/users/d3f6939b7b044738b79d0c59a82be190` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:13.590068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f6939b7b044738b79d0c59a82be190)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:13.592598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:13.781980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f6939b7b044738b79d0c59a82be190'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.782818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f6939b7b044738b79d0c59a82be190'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.794941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f6939b7b044738b79d0c59a82be190'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.802489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f6939b7b044738b79d0c59a82be190'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.868332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-44ffe3b6-974b-4ae8-adc8-6cac6ce7219d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f6939b7b044738b79d0c59a82be190'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:13.875667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 941/1878] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:13 2022] DELETE /identity/v3/users/d3f6939b7b044738b79d0c59a82be190 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:14.317878 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:14.319505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:14.336080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1602c4-bf56-4c5b-aeb5-e8bc4bd3aa50 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:14.393174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:14.393947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:14.394293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:14.394544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] PATH_INFO: `/v3/projects/36cd3a54306047ee8d32b5693e5958fb` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:14.395749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cd3a54306047ee8d32b5693e5958fb)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:14.397631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:14.501739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cd3a54306047ee8d32b5693e5958fb', 'request_id': 'req-d639ec44-5277-4feb-9843-043683c24371'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:14.567472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cd3a54306047ee8d32b5693e5958fb', 'request_id': 'req-d639ec44-5277-4feb-9843-043683c24371'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:14.573526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cd3a54306047ee8d32b5693e5958fb', 'request_id': 'req-d639ec44-5277-4feb-9843-043683c24371'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:14.583963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] The token cache is being invalidate because project 36cd3a54306047ee8d32b5693e5958fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:14.584248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:14.584882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d639ec44-5277-4feb-9843-043683c24371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:14.586436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 938/1879] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:14 2022] DELETE /identity/v3/projects/36cd3a54306047ee8d32b5693e5958fb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:14.592066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12fd8b-16e4-4507-af2d-fd989e5118db None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:14.592542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12fd8b-16e4-4507-af2d-fd989e5118db None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:14.597115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12fd8b-16e4-4507-af2d-fd989e5118db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:14.611598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ac12fd8b-16e4-4507-af2d-fd989e5118db None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:14.612798 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ac12fd8b-16e4-4507-af2d-fd989e5118db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:14.670465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 942/1880] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:14.678434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164a40c-2a00-45e6-87e6-0f3bb416610e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:14.678723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164a40c-2a00-45e6-87e6-0f3bb416610e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:14.679030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164a40c-2a00-45e6-87e6-0f3bb416610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:14.697711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f164a40c-2a00-45e6-87e6-0f3bb416610e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:14.698963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f164a40c-2a00-45e6-87e6-0f3bb416610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:14.712248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 939/1881] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:14.713400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12fd8b-16e4-4507-af2d-fd989e5118db None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:14.723484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12fd8b-16e4-4507-af2d-fd989e5118db None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:14.728206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:14.728860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:14.729134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:14.729406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:14.730135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:14.730433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:14.732064 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:14.744441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 943/1882] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:14.748561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164a40c-2a00-45e6-87e6-0f3bb416610e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:14.758759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164a40c-2a00-45e6-87e6-0f3bb416610e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:14.763813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:14.764489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:14.764800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:14.765626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:14.766350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:14.768322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:14.856440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 940/1883] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:14 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:14.857607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:14.868854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7501be5-f0df-4dfd-aa34-e449034fc112 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:14.925258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:14.925835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:14.926112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:14.926383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:14.927116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:14.929027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.006273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 944/1884] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:14 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:15.010308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.021172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe906a3-dd41-491b-8378-3c5f54328e6e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.025819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.026477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.026759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.027063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.027826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.029414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.041055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 941/1885] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:15.044990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.055397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03d697-38ae-418f-894c-af6bf0c5dd39 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.060160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2290f22-3b22-4b18-8a39-8afd3f683f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.060949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290f22-3b22-4b18-8a39-8afd3f683f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.061617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290f22-3b22-4b18-8a39-8afd3f683f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.061973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2290f22-3b22-4b18-8a39-8afd3f683f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.062956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2290f22-3b22-4b18-8a39-8afd3f683f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.069005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2290f22-3b22-4b18-8a39-8afd3f683f0e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.088589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 945/1886] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:15.093545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.104392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917735-a85a-436d-a538-855f8fb0044c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.112376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.113392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.113775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.114195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] PATH_INFO: `/v3/projects/b025424891074d1cac77d20e0f9f4693/users/ccf6bd596ca7419aa08894ec86df98f1/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.135279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b025424891074d1cac77d20e0f9f4693, user_id=ccf6bd596ca7419aa08894ec86df98f1, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.137729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.225052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 942/1887] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:15 2022] PUT /identity/v3/projects/b025424891074d1cac77d20e0f9f4693/users/ccf6bd596ca7419aa08894ec86df98f1/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:15.240289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc9b0d-86ca-47cf-9284-c4b55f78f3e5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.240580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc9b0d-86ca-47cf-9284-c4b55f78f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.240858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc9b0d-86ca-47cf-9284-c4b55f78f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.270322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-2ecc9b0d-86ca-47cf-9284-c4b55f78f3e5 None None] MFA Rules not processed for user `ccf6bd596ca7419aa08894ec86df98f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:15.271635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-2ecc9b0d-86ca-47cf-9284-c4b55f78f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:15.346628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 946/1888] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:15.350943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.428328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1eb7d-d5b7-4aff-b4a0-67d06b69feb8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.434586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.434586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.434586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.434586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.434966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.437434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.551687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 943/1889] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:15 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:15.555850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc9b0d-86ca-47cf-9284-c4b55f78f3e5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.567442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc9b0d-86ca-47cf-9284-c4b55f78f3e5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.620948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.621597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.621874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.622144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.622866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.625312 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.698584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 947/1890] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:15 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:15.703376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.713378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee18afa-a8a0-4cb5-b55f-50973bc60c00 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.717957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.718643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.718961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.719235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.719966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.721580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.731756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 944/1891] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:15.736393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.746382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d670c8-04cf-4af8-9aa7-dfffd3f3bb1b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.751907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5e5e7-6590-4604-a000-c9e122779e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.752546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e5e7-6590-4604-a000-c9e122779e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.752824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e5e7-6590-4604-a000-c9e122779e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.753095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e5e7-6590-4604-a000-c9e122779e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.753827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5e5e7-6590-4604-a000-c9e122779e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.755696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5e5e7-6590-4604-a000-c9e122779e3a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.765547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 948/1892] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:15.769531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:15.779190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa36eb-f315-4420-9809-2dc06efe23ae admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:15.783841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:15.784695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.784976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.785251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] PATH_INFO: `/v3/projects/962a52eb8b31484cbd53abded6cf8c56/users/2d288206226d4f829d864fcc58e547f5/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.800037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962a52eb8b31484cbd53abded6cf8c56, user_id=2d288206226d4f829d864fcc58e547f5, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:15.802679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:15.907305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 945/1893] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:15 2022] PUT /identity/v3/projects/962a52eb8b31484cbd53abded6cf8c56/users/2d288206226d4f829d864fcc58e547f5/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:15.909141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affa54e-d833-493c-a998-734145e2bc44 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:15.910130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affa54e-d833-493c-a998-734145e2bc44 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:15.910130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affa54e-d833-493c-a998-734145e2bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:15.941026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-4affa54e-d833-493c-a998-734145e2bc44 None None] MFA Rules not processed for user `2d288206226d4f829d864fcc58e547f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:15.942525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4affa54e-d833-493c-a998-734145e2bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:16.018604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 949/1894] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:16.022975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:16.082265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd66df3-4da3-454c-b9cc-7cdb2bb9c521 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:16.086899 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:16.087547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.087825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.088095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.088804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:16.090731 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:16.186433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 946/1895] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:16 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:16.190445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affa54e-d833-493c-a998-734145e2bc44 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:16.201482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affa54e-d833-493c-a998-734145e2bc44 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:16.267521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:16.268189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.268493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.268763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.269500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:16.271440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:16.477172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 950/1896] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:16 2022] POST /identity/v3/users => generated 295 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:16.478370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:16.489741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db080fc2-ac3c-492b-be0d-4a02190534fb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:16.494262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:16.495111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.495390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.495661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.496425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:16.498019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:16.509420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 947/1897] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:16.513632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:16.523470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee4a8-661b-4734-848d-8cfca289fd84 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:16.528052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:16.528915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.529192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.529461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] PATH_INFO: `/v3/projects/a58204131dc044f0b4e0628810319a06/users/03d8db609cbd45e8913aeb77ca0d9076/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.543907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58204131dc044f0b4e0628810319a06, user_id=03d8db609cbd45e8913aeb77ca0d9076, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:16.547092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:16.614035 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 951/1898] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:16 2022] PUT /identity/v3/projects/a58204131dc044f0b4e0628810319a06/users/03d8db609cbd45e8913aeb77ca0d9076/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:16.618099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:16.628648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78f45f-5f65-4ecf-b743-10c7efac0da6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:16.689132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdf9b4-b3a9-4b8c-851e-3842bd0b3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:16.690620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdf9b4-b3a9-4b8c-851e-3842bd0b3737 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.691174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdf9b4-b3a9-4b8c-851e-3842bd0b3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.691572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdf9b4-b3a9-4b8c-851e-3842bd0b3737 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.692443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdf9b4-b3a9-4b8c-851e-3842bd0b3737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:16.694309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdf9b4-b3a9-4b8c-851e-3842bd0b3737 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:16.705757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 948/1899] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:16.709974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:16.720359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0158b9-d620-4800-8241-bb35388d1681 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:16.725013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:16.725907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.726188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.726466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] PATH_INFO: `/v3/projects/a58204131dc044f0b4e0628810319a06/users/03d8db609cbd45e8913aeb77ca0d9076/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.728783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58204131dc044f0b4e0628810319a06, user_id=03d8db609cbd45e8913aeb77ca0d9076, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:16.731232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:16.741907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 952/1900] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:16 2022] PUT /identity/v3/projects/a58204131dc044f0b4e0628810319a06/users/03d8db609cbd45e8913aeb77ca0d9076/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:16.758620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.758947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.759228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.785706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] MFA Rules not processed for user `03d8db609cbd45e8913aeb77ca0d9076`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:16.786929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:16.857762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 949/1901] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:16.869199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:16.871261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:16.931575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e705f-7f8e-4a39-9a52-2a0553afc1b1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:16.936044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:16.936349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:16.936670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:16.937024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:16.999518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:17.001352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:17.012135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 953/1902] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:20.724258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:20.725670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:20.796797 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77a16-8044-4f52-a37b-095d2f677b8c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:20.801792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:20.802644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:20.802957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:20.803230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] PATH_INFO: `/v3/users/a4b73dedb768446494532b70c78adf0a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:20.804428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b73dedb768446494532b70c78adf0a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:20.806339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:20.984364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:20.986426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:20.999468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4177-d32b-4844-8294-7b7af01bfff3 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:21.001266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b73dedb768446494532b70c78adf0a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:21.006405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbf406-08a7-40b5-a82f-bb791fd32674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:21.007364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf406-08a7-40b5-a82f-bb791fd32674 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:21.007904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf406-08a7-40b5-a82f-bb791fd32674 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:21.008463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbf406-08a7-40b5-a82f-bb791fd32674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:21.075912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b73dedb768446494532b70c78adf0a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:21.080875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf406-08a7-40b5-a82f-bb791fd32674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:21.080875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbf406-08a7-40b5-a82f-bb791fd32674 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:21.081077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b73dedb768446494532b70c78adf0a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:21.081077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b73dedb768446494532b70c78adf0a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:21.092091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 954/1903] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:21.121865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b73dedb768446494532b70c78adf0a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:21.145053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 950/1904] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:20 2022] DELETE /identity/v3/users/a4b73dedb768446494532b70c78adf0a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:21.152896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:21.153184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:21.153458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:21.178116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:21.178116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:21.261102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 955/1905] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:21.274041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:21.275592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:21.343706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d664a-d810-4d35-809f-641a7c43fed1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:21.349264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:21.349904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:21.350191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:21.350468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:21.361728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:21.364232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:21.374691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 951/1906] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:21.897928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:21.899698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:21.917331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffa241-06a9-4a92-be1f-84001e1bad15 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:21.925877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:21.927198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:21.927603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:21.927992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] PATH_INFO: `/v3/projects/103398c60ede4b46b245126d59bd83f3` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:21.929949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] RBAC: Authorizing `identity:delete_project(project_id=103398c60ede4b46b245126d59bd83f3)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:21.932562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:22.058896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103398c60ede4b46b245126d59bd83f3', 'request_id': 'req-dee37728-24a7-4d57-aa65-72b93e1e929e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.065419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103398c60ede4b46b245126d59bd83f3', 'request_id': 'req-dee37728-24a7-4d57-aa65-72b93e1e929e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.178555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103398c60ede4b46b245126d59bd83f3', 'request_id': 'req-dee37728-24a7-4d57-aa65-72b93e1e929e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.190900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] The token cache is being invalidate because project 103398c60ede4b46b245126d59bd83f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:22.191191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.192440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.193995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 956/1907] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:21 2022] DELETE /identity/v3/projects/103398c60ede4b46b245126d59bd83f3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:22.200117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:22.211659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34175e4-046b-4171-88fd-419b2b0b3ff9 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:22.282020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:22.282939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:22.283226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:22.283499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] PATH_INFO: `/v3/users/77f1c9c299ea4b038cd62a19b1e49bec` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:22.284718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f1c9c299ea4b038cd62a19b1e49bec)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:22.286888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:22.432197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f1c9c299ea4b038cd62a19b1e49bec'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.492698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f1c9c299ea4b038cd62a19b1e49bec'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.493317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f1c9c299ea4b038cd62a19b1e49bec'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.493937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f1c9c299ea4b038cd62a19b1e49bec'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.501022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e3a043bb-c97e-4c9d-9735-16161e0b4168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f1c9c299ea4b038cd62a19b1e49bec'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:22.518314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 952/1908] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:22 2022] DELETE /identity/v3/users/77f1c9c299ea4b038cd62a19b1e49bec => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:22.909368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:22.911158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:22.941674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37728-24a7-4d57-aa65-72b93e1e929e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.002592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.003574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.003930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.005072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] PATH_INFO: `/v3/projects/e54c770638304489968a927ff619c9c4` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.005883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54c770638304489968a927ff619c9c4)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.007973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.153283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54c770638304489968a927ff619c9c4', 'request_id': 'req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:23.160863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54c770638304489968a927ff619c9c4', 'request_id': 'req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:23.274132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54c770638304489968a927ff619c9c4', 'request_id': 'req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:23.304789 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] The token cache is being invalidate because project e54c770638304489968a927ff619c9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:23.305647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:23.307225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b4aa5647-6f3b-4b64-9ab5-568a9ecb8bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:23.310617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 957/1909] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:22 2022] DELETE /identity/v3/projects/e54c770638304489968a927ff619c9c4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:23.316805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aaa9-cbf3-495f-9b31-66f3222f5bcd None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.317395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aaa9-cbf3-495f-9b31-66f3222f5bcd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.317395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aaa9-cbf3-495f-9b31-66f3222f5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.356271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6373aaa9-cbf3-495f-9b31-66f3222f5bcd None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:23.357677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6373aaa9-cbf3-495f-9b31-66f3222f5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:23.428493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 953/1910] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:23.436227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ae93-b6f9-495c-a1b6-1561656cc009 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.439207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ae93-b6f9-495c-a1b6-1561656cc009 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.439207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31ae93-b6f9-495c-a1b6-1561656cc009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.462145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ae31ae93-b6f9-495c-a1b6-1561656cc009 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:23.463395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ae31ae93-b6f9-495c-a1b6-1561656cc009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:23.473632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 958/1911] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:23.476218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aaa9-cbf3-495f-9b31-66f3222f5bcd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:23.488898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aaa9-cbf3-495f-9b31-66f3222f5bcd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.494540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.495501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.495782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.496056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.496914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:23.497287 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.499903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.513826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 954/1912] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:23.517209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ae93-b6f9-495c-a1b6-1561656cc009 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:23.526504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31ae93-b6f9-495c-a1b6-1561656cc009 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.531850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.532510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.532794 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.533088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.533986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.535940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.627393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 959/1913] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:23 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:23.647963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:23.653281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:23.655201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:23.658066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed3bc9-3721-4352-89aa-e1ec8db6e5b2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.711080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991937bf-c42b-4006-8dc5-ee8e0970f350 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.712644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.713318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.713647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.714029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.714632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.714783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.715445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.715728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.716005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.716687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.717829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:23.778729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.780153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.789555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 960/1914] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:46:23.807436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 955/1915] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:23 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:23.811987 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:23.822108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0daa8-f1d7-49cd-bec4-2f6cdde6e770 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.826759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.828161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.828453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.828733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.829464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.831105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.840746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 961/1916] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:23.844885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:23.854622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c4cbd-658c-4d71-9ac9-fd65e8d17813 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.859678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ddeef-6dde-4642-8a19-7206dbecdb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.860358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddeef-6dde-4642-8a19-7206dbecdb0e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.862998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddeef-6dde-4642-8a19-7206dbecdb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.862998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddeef-6dde-4642-8a19-7206dbecdb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.862998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddeef-6dde-4642-8a19-7206dbecdb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.863313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddeef-6dde-4642-8a19-7206dbecdb0e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.872983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 956/1917] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:23.877560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:23.887792 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1ade4-e5ef-41ef-890c-24a3e2d9d2e6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:23.894977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:23.895943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:23.896247 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:23.896524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] PATH_INFO: `/v3/projects/763ad07bd5014dd194783011b03e35a8/users/e5f18e9baefd463bb892ed7eda72d774/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:23.912753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763ad07bd5014dd194783011b03e35a8, user_id=e5f18e9baefd463bb892ed7eda72d774, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:23.915437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:23.996692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 962/1918] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:23 2022] PUT /identity/v3/projects/763ad07bd5014dd194783011b03e35a8/users/e5f18e9baefd463bb892ed7eda72d774/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:24.007565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573e053-f46d-4ba1-bde3-11bb61d3bc99 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.008057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573e053-f46d-4ba1-bde3-11bb61d3bc99 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.008339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573e053-f46d-4ba1-bde3-11bb61d3bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.039929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c573e053-f46d-4ba1-bde3-11bb61d3bc99 None None] MFA Rules not processed for user `e5f18e9baefd463bb892ed7eda72d774`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:24.041055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c573e053-f46d-4ba1-bde3-11bb61d3bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:24.105682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 957/1919] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:24.110303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:24.171277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257c15-154e-4fb9-86e0-eda08bd17449 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:24.176039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:24.176692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.176975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.177248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.177951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:24.179898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:24.260244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 963/1920] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:24 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:24.266948 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573e053-f46d-4ba1-bde3-11bb61d3bc99 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:24.277412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573e053-f46d-4ba1-bde3-11bb61d3bc99 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:24.332579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:24.333206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.333445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.333722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.334436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:24.336451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:24.487581 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 958/1921] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:24 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:24.491315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:24.502518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7905-6bf8-499f-84c7-6dceab4918f3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:24.507760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:24.508419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.508702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.508979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.509712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:24.511367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:24.522674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 964/1922] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:24.526913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:24.536940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9115f-6125-486e-8c2d-de9de9bc89da admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:24.541534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:24.542410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.542692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.543002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] PATH_INFO: `/v3/projects/f8f9cf821b744bd18fae2292fcadf6c8/users/d5d30c76c57a4db28f6303eb6ccc10f0/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.557692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f9cf821b744bd18fae2292fcadf6c8, user_id=d5d30c76c57a4db28f6303eb6ccc10f0, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:24.560421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:24.631327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 959/1923] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:24 2022] PUT /identity/v3/projects/f8f9cf821b744bd18fae2292fcadf6c8/users/d5d30c76c57a4db28f6303eb6ccc10f0/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:24.635336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:24.646302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92009-b575-4b1e-9c00-8269b5eaf119 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:24.701286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbc7a4-2209-4e7c-aa8c-d678ac66c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:24.702717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc7a4-2209-4e7c-aa8c-d678ac66c4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.703068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc7a4-2209-4e7c-aa8c-d678ac66c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.703332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc7a4-2209-4e7c-aa8c-d678ac66c4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.704075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbc7a4-2209-4e7c-aa8c-d678ac66c4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:24.705668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbc7a4-2209-4e7c-aa8c-d678ac66c4d6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:24.715573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 965/1924] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:24.720240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:24.730131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28299a1f-e6c3-4fc4-8193-3d5783b65dc9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:24.735406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:24.736295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.736579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.736982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] PATH_INFO: `/v3/projects/f8f9cf821b744bd18fae2292fcadf6c8/users/d5d30c76c57a4db28f6303eb6ccc10f0/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.739016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f9cf821b744bd18fae2292fcadf6c8, user_id=d5d30c76c57a4db28f6303eb6ccc10f0, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:24.741657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:24.752969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 960/1925] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:24 2022] PUT /identity/v3/projects/f8f9cf821b744bd18fae2292fcadf6c8/users/d5d30c76c57a4db28f6303eb6ccc10f0/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:24.763935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588947fe-5b29-4cbb-af00-2ead04022086 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.764222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588947fe-5b29-4cbb-af00-2ead04022086 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.764953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588947fe-5b29-4cbb-af00-2ead04022086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.790292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-588947fe-5b29-4cbb-af00-2ead04022086 None None] MFA Rules not processed for user `d5d30c76c57a4db28f6303eb6ccc10f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:24.791518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-588947fe-5b29-4cbb-af00-2ead04022086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:24.857768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 966/1926] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:24.867678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:24.869439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:24.923805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4cf4-e18a-4996-ba03-fd99c38f566a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:24.927366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b518817-3e53-4acb-85ec-4cc83dee2805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:24.927991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518817-3e53-4acb-85ec-4cc83dee2805 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:24.928270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518817-3e53-4acb-85ec-4cc83dee2805 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:24.928544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b518817-3e53-4acb-85ec-4cc83dee2805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:24.937866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b518817-3e53-4acb-85ec-4cc83dee2805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:24.939346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b518817-3e53-4acb-85ec-4cc83dee2805 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:24.948474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 961/1927] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:26.020358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588947fe-5b29-4cbb-af00-2ead04022086 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:26.081840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588947fe-5b29-4cbb-af00-2ead04022086 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:26.087485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:26.088457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:26.088834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:26.089205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] PATH_INFO: `/v3/users/e5f18e9baefd463bb892ed7eda72d774` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:26.090629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f18e9baefd463bb892ed7eda72d774)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:26.092841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:26.252129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f18e9baefd463bb892ed7eda72d774'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:26.252710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f18e9baefd463bb892ed7eda72d774'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:26.264317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f18e9baefd463bb892ed7eda72d774'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:26.271118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f18e9baefd463bb892ed7eda72d774'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:26.347469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f18e9baefd463bb892ed7eda72d774'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:26.353580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 967/1928] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:26 2022] DELETE /identity/v3/users/e5f18e9baefd463bb892ed7eda72d774 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:26.358927 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:26.359416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:26.359514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:26.377554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:26.378748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:26.440892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 962/1929] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:26.448981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:26.450463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:26.510689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f5d29-1ace-4bff-8518-89c6b8f82ed0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:26.514489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:26.515457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:26.515742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:26.516073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:26.526038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:26.527734 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:26.543293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 968/1930] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:26.900351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:26.901755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:26.916159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa1476-a3f9-4caa-8c73-e6205756ccbf None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:26.922738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:26.923636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:26.924061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:26.924420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] PATH_INFO: `/v3/projects/763ad07bd5014dd194783011b03e35a8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:26.926873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763ad07bd5014dd194783011b03e35a8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:26.928651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:27.056484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763ad07bd5014dd194783011b03e35a8', 'request_id': 'req-03f145b8-567c-49b5-8792-3c5d29638f50'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.132716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763ad07bd5014dd194783011b03e35a8', 'request_id': 'req-03f145b8-567c-49b5-8792-3c5d29638f50'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.141881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763ad07bd5014dd194783011b03e35a8', 'request_id': 'req-03f145b8-567c-49b5-8792-3c5d29638f50'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.159972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] The token cache is being invalidate because project 763ad07bd5014dd194783011b03e35a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:27.160268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.162047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.164007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 963/1931] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:26 2022] DELETE /identity/v3/projects/763ad07bd5014dd194783011b03e35a8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:27.174742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:27.185517 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28bfe8-3a0c-4821-8108-74eb47c73ac0 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:27.264656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:27.266379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:27.266896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:27.267357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] PATH_INFO: `/v3/users/d5d30c76c57a4db28f6303eb6ccc10f0` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:27.268995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d30c76c57a4db28f6303eb6ccc10f0)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:27.272038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:27.559134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d30c76c57a4db28f6303eb6ccc10f0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.559859 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d30c76c57a4db28f6303eb6ccc10f0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.573803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d30c76c57a4db28f6303eb6ccc10f0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.584488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d30c76c57a4db28f6303eb6ccc10f0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.664193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c67ecc1e-f858-497a-9127-6985cd234879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d30c76c57a4db28f6303eb6ccc10f0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:27.670762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 969/1932] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:27 2022] DELETE /identity/v3/users/d5d30c76c57a4db28f6303eb6ccc10f0 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:28.076873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:28.079013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:28.095135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f145b8-567c-49b5-8792-3c5d29638f50 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:28.168592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:28.171076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:28.171613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:28.172166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] PATH_INFO: `/v3/projects/f8f9cf821b744bd18fae2292fcadf6c8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:28.181085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f9cf821b744bd18fae2292fcadf6c8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:28.183048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:28.356615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f9cf821b744bd18fae2292fcadf6c8', 'request_id': 'req-a86f5042-9a18-4002-91f3-9c205ee77f81'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:28.436717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f9cf821b744bd18fae2292fcadf6c8', 'request_id': 'req-a86f5042-9a18-4002-91f3-9c205ee77f81'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:28.443461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f9cf821b744bd18fae2292fcadf6c8', 'request_id': 'req-a86f5042-9a18-4002-91f3-9c205ee77f81'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:28.454663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] The token cache is being invalidate because project f8f9cf821b744bd18fae2292fcadf6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:28.455035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:28.455716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a86f5042-9a18-4002-91f3-9c205ee77f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:28.457271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 964/1933] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:28 2022] DELETE /identity/v3/projects/f8f9cf821b744bd18fae2292fcadf6c8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:28.465232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4459b2-b1d1-4f5c-82bc-266db65add23 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:28.465232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4459b2-b1d1-4f5c-82bc-266db65add23 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:28.465232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4459b2-b1d1-4f5c-82bc-266db65add23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:28.485378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ab4459b2-b1d1-4f5c-82bc-266db65add23 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:28.486457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ab4459b2-b1d1-4f5c-82bc-266db65add23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:28.558128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 970/1934] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:28.566164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cee78-eac3-4ff2-b4e1-8d89903b142d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:28.566459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cee78-eac3-4ff2-b4e1-8d89903b142d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:28.566742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cee78-eac3-4ff2-b4e1-8d89903b142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:28.586028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fa2cee78-eac3-4ff2-b4e1-8d89903b142d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:28.587299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fa2cee78-eac3-4ff2-b4e1-8d89903b142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:28.596064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 965/1935] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:28.600481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4459b2-b1d1-4f5c-82bc-266db65add23 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:28.614342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4459b2-b1d1-4f5c-82bc-266db65add23 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:28.619080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:28.619747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:28.620042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:28.620393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:28.621143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:28.621446 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:28.623166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:28.636351 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 971/1936] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:28.641312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cee78-eac3-4ff2-b4e1-8d89903b142d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:28.650594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cee78-eac3-4ff2-b4e1-8d89903b142d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:28.656332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:28.656987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:28.657265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:28.657567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:28.658235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:28.660154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:28.808776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 966/1937] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:28 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:28.808878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:28.829895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82f2ce-0005-4d98-9573-810617385ef1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:28.891010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:28.891738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:28.892016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:28.892290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:28.893001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:28.894936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:28.994714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 972/1938] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:28 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:28.999993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:29.011029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593962ea-564b-4347-8006-1afda99ec263 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:29.020569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:29.021295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:29.021586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:29.021859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:29.022601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:29.024312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:29.035710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 967/1939] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:29.045730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:29.056004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a184a-c112-430a-b8dc-e541c797c52d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:29.061568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5243a-5886-4076-85bf-5fc180bfe645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:29.062397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5243a-5886-4076-85bf-5fc180bfe645 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:29.062692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5243a-5886-4076-85bf-5fc180bfe645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:29.063002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5243a-5886-4076-85bf-5fc180bfe645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:29.063742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5243a-5886-4076-85bf-5fc180bfe645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:29.065338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5243a-5886-4076-85bf-5fc180bfe645 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:29.077801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 973/1940] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:29.082032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:29.092587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc7a3-e56b-412a-af85-da767933bd20 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:29.097888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:29.098874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:29.099231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:29.099568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] PATH_INFO: `/v3/projects/922dc3003f814a61b66cfda2b8e779a0/users/7d1453e130254232afd3fd4785726157/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:29.118864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922dc3003f814a61b66cfda2b8e779a0, user_id=7d1453e130254232afd3fd4785726157, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:29.118864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:29.223095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 968/1941] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:29 2022] PUT /identity/v3/projects/922dc3003f814a61b66cfda2b8e779a0/users/7d1453e130254232afd3fd4785726157/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:29.234150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceab4f-dee3-472a-8ed1-135e6a55a107 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:29.234440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceab4f-dee3-472a-8ed1-135e6a55a107 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:29.234719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceab4f-dee3-472a-8ed1-135e6a55a107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:29.263063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-72ceab4f-dee3-472a-8ed1-135e6a55a107 None None] MFA Rules not processed for user `7d1453e130254232afd3fd4785726157`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:29.264254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-72ceab4f-dee3-472a-8ed1-135e6a55a107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:29.349588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 974/1942] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:29.360778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:29.362650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:29.426331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a206066-0127-4901-a443-4d438a5cb452 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:29.430317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b371-6948-4220-a37a-9d11f72e249e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:29.430989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b371-6948-4220-a37a-9d11f72e249e service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:29.431295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b371-6948-4220-a37a-9d11f72e249e service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:29.431567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b371-6948-4220-a37a-9d11f72e249e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:29.441843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b371-6948-4220-a37a-9d11f72e249e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:29.443331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b371-6948-4220-a37a-9d11f72e249e service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:29.452542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 969/1943] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:29.472178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceab4f-dee3-472a-8ed1-135e6a55a107 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:29.551276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceab4f-dee3-472a-8ed1-135e6a55a107 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:29.557509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:29.563488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:29.563488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:29.563488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] PATH_INFO: `/v3/users/7d1453e130254232afd3fd4785726157` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:29.563488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1453e130254232afd3fd4785726157)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:29.563488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:29.776053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1453e130254232afd3fd4785726157'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:29.776787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1453e130254232afd3fd4785726157'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:29.792319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1453e130254232afd3fd4785726157'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:29.815738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1453e130254232afd3fd4785726157'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:29.910469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1453e130254232afd3fd4785726157'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:29.917629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 975/1944] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:29 2022] DELETE /identity/v3/users/7d1453e130254232afd3fd4785726157 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:29.923173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:29.923463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:29.923731 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:29.944164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:29.949046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:30.066965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 970/1945] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:30.091545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:30.093673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:30.179535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e11ec-d9db-4c07-9ebf-7bb7c82899bc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:30.184406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090595-baef-4bcf-8926-e23845f9220f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:30.190413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090595-baef-4bcf-8926-e23845f9220f service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:30.190413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090595-baef-4bcf-8926-e23845f9220f service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:30.190413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090595-baef-4bcf-8926-e23845f9220f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:30.197240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090595-baef-4bcf-8926-e23845f9220f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:30.198870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090595-baef-4bcf-8926-e23845f9220f service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:30.212634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 976/1946] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:30.714621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:30.716164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:30.728958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfdbeb-6749-4ece-a30d-732264cb80c2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:30.739521 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:30.741557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:30.741557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:30.741557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] PATH_INFO: `/v3/projects/922dc3003f814a61b66cfda2b8e779a0` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:30.742983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922dc3003f814a61b66cfda2b8e779a0)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:30.745354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:30.885771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922dc3003f814a61b66cfda2b8e779a0', 'request_id': 'req-7c1b756c-614a-4371-b5b9-d28ff77e31a0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:30.961192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922dc3003f814a61b66cfda2b8e779a0', 'request_id': 'req-7c1b756c-614a-4371-b5b9-d28ff77e31a0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:30.969513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922dc3003f814a61b66cfda2b8e779a0', 'request_id': 'req-7c1b756c-614a-4371-b5b9-d28ff77e31a0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:30.981643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] The token cache is being invalidate because project 922dc3003f814a61b66cfda2b8e779a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:30.981966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:30.982726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c1b756c-614a-4371-b5b9-d28ff77e31a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:30.986027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 971/1947] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:30 2022] DELETE /identity/v3/projects/922dc3003f814a61b66cfda2b8e779a0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:30.991510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0a282-a784-4084-a3d8-b49f5da0297a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:30.991977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0a282-a784-4084-a3d8-b49f5da0297a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:30.992206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0a282-a784-4084-a3d8-b49f5da0297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.011774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c2b0a282-a784-4084-a3d8-b49f5da0297a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:31.013096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c2b0a282-a784-4084-a3d8-b49f5da0297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:31.091019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 977/1948] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:31.100765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf7a03-71ec-4731-af07-a9693728ebd6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.101052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf7a03-71ec-4731-af07-a9693728ebd6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.101336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf7a03-71ec-4731-af07-a9693728ebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.127313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d7bf7a03-71ec-4731-af07-a9693728ebd6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:31.128709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d7bf7a03-71ec-4731-af07-a9693728ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:31.140065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 972/1949] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:31.145122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0a282-a784-4084-a3d8-b49f5da0297a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:31.159673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0a282-a784-4084-a3d8-b49f5da0297a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:31.165336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:31.166211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.166666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.167307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.167938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:31.168243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:31.169905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:31.186842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 978/1950] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:46:31.190042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf7a03-71ec-4731-af07-a9693728ebd6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:31.200604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf7a03-71ec-4731-af07-a9693728ebd6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:31.208470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:31.209234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.209609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.209960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.210744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:31.212978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:31.345962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 973/1951] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:31 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:31.346785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:31.358461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2905c-feee-47d9-8ca3-516c0be7b884 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:31.450091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:31.451061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.452163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.452711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.453497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:31.455604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:31.556222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 979/1952] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:31 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:31.560465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:31.570616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b954b-56af-42e7-9ce0-823c3e399e34 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:31.589288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:31.590148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.590442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.590716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.591869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:31.593779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:31.615826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:31.616249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 974/1953] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:31.625983 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87713f0-9d84-4399-aebe-4987cb0161f8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:31.631374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc942e-1f16-45f8-a207-99a821217825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:31.632060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc942e-1f16-45f8-a207-99a821217825 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.632343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc942e-1f16-45f8-a207-99a821217825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.632615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc942e-1f16-45f8-a207-99a821217825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.633345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc942e-1f16-45f8-a207-99a821217825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:31.634953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc942e-1f16-45f8-a207-99a821217825 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:31.647104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 980/1954] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:31.651432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:31.661933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d072a20-5c8d-4bf8-a503-6b3f97e34ef5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:31.667274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:31.668154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.668434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.668705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] PATH_INFO: `/v3/projects/fa0090f876014fbb8b8682ec4a418abc/users/971c4fa16e69499a8784f074d09717ee/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.685979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0090f876014fbb8b8682ec4a418abc, user_id=971c4fa16e69499a8784f074d09717ee, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:31.694219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:31.768060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 975/1955] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:31 2022] PUT /identity/v3/projects/fa0090f876014fbb8b8682ec4a418abc/users/971c4fa16e69499a8784f074d09717ee/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:31.778748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.779075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.779362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.807384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] MFA Rules not processed for user `971c4fa16e69499a8784f074d09717ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:31.808620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:31.872304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 981/1956] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:31.886402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:31.888323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:31.949752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b877cc-161b-4bd4-8793-c0cc7e8c7e1b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:31.954710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff6c8-4ca7-4e4a-9ab3-2cafd66bf713 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72317f5c187c41e9b2d1c53c9cedcd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:31.955522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff6c8-4ca7-4e4a-9ab3-2cafd66bf713 service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:31.955806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff6c8-4ca7-4e4a-9ab3-2cafd66bf713 service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:31.956077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff6c8-4ca7-4e4a-9ab3-2cafd66bf713 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:31.964720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff6c8-4ca7-4e4a-9ab3-2cafd66bf713 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:31.966176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff6c8-4ca7-4e4a-9ab3-2cafd66bf713 service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:31.975457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 976/1957] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:33.666262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:33.667847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:33.734236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a668c-1618-4c3c-bc54-6be1cae6e37f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:33.738764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:33.739642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:33.739921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:33.740193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] PATH_INFO: `/v3/users/936c9016c87f4a4fa79bba2daf1b4f9c` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:33.741380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=936c9016c87f4a4fa79bba2daf1b4f9c)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:33.743339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:33.968238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936c9016c87f4a4fa79bba2daf1b4f9c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:33.968901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936c9016c87f4a4fa79bba2daf1b4f9c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:33.981027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936c9016c87f4a4fa79bba2daf1b4f9c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:33.988306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936c9016c87f4a4fa79bba2daf1b4f9c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:34.047131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936c9016c87f4a4fa79bba2daf1b4f9c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:34.053457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 982/1958] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:33 2022] DELETE /identity/v3/users/936c9016c87f4a4fa79bba2daf1b4f9c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:34.062981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:34.063446 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:34.063528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:34.081460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:34.082643 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:34.141437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 977/1959] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:34.151691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:34.153130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:34.211847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ed91e-0564-4ed0-a4c7-23a426695194 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:34.215361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:34.215993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:34.216271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:34.216539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:34.225382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:34.226816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:34.236248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 983/1960] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:34.619455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:34.621276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:34.633558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745e3dc-41c2-45f1-88fc-8ce10d653de6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:34.638219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:34.639096 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:34.639401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:34.639661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] PATH_INFO: `/v3/projects/56198b7071d7441e96e3efdc9772c1da` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:34.640820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] RBAC: Authorizing `identity:delete_project(project_id=56198b7071d7441e96e3efdc9772c1da)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:34.643540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:34.741118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56198b7071d7441e96e3efdc9772c1da', 'request_id': 'req-6222983b-63ae-4f09-9660-77df1490846a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:34.804554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56198b7071d7441e96e3efdc9772c1da', 'request_id': 'req-6222983b-63ae-4f09-9660-77df1490846a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:34.811036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56198b7071d7441e96e3efdc9772c1da', 'request_id': 'req-6222983b-63ae-4f09-9660-77df1490846a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:34.821457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] The token cache is being invalidate because project 56198b7071d7441e96e3efdc9772c1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:34.821740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:34.822358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:34.823902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 978/1961] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:34 2022] DELETE /identity/v3/projects/56198b7071d7441e96e3efdc9772c1da => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:34.828173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:34.838404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096254-010b-4a7f-b184-439387e36725 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:34.893320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:34.894217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:34.894493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:34.894765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] PATH_INFO: `/v3/users/7d261e877d5b4ab08e1ead39c603c2eb` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:34.896009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d261e877d5b4ab08e1ead39c603c2eb)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:34.897925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:35.116872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d261e877d5b4ab08e1ead39c603c2eb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.117548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d261e877d5b4ab08e1ead39c603c2eb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.132853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d261e877d5b4ab08e1ead39c603c2eb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.139934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d261e877d5b4ab08e1ead39c603c2eb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.223626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-77c3817d-d6d9-4bc2-b06e-38a0e4de1c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d261e877d5b4ab08e1ead39c603c2eb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.229895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 984/1962] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:34 2022] DELETE /identity/v3/users/7d261e877d5b4ab08e1ead39c603c2eb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:35.623326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:35.624883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:35.640847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222983b-63ae-4f09-9660-77df1490846a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:35.697897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:35.698838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:35.699083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:35.699358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] PATH_INFO: `/v3/projects/49d3ef268ee94ff7b886f7072823c161` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:35.700558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d3ef268ee94ff7b886f7072823c161)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:35.702496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:35.823998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d3ef268ee94ff7b886f7072823c161', 'request_id': 'req-f24bcbca-4b30-4378-85d6-6f62a483bc3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.909534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d3ef268ee94ff7b886f7072823c161', 'request_id': 'req-f24bcbca-4b30-4378-85d6-6f62a483bc3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.916506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d3ef268ee94ff7b886f7072823c161', 'request_id': 'req-f24bcbca-4b30-4378-85d6-6f62a483bc3c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.927602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] The token cache is being invalidate because project 49d3ef268ee94ff7b886f7072823c161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:35.927886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.928529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-f24bcbca-4b30-4378-85d6-6f62a483bc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:35.930265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 979/1963] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:35 2022] DELETE /identity/v3/projects/49d3ef268ee94ff7b886f7072823c161 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:35.936385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c9d1-b5ea-42a3-b361-3e994da9f322 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:35.936921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c9d1-b5ea-42a3-b361-3e994da9f322 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:35.936921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c9d1-b5ea-42a3-b361-3e994da9f322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:35.956206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-6933c9d1-b5ea-42a3-b361-3e994da9f322 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:35.957301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6933c9d1-b5ea-42a3-b361-3e994da9f322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:36.027457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 985/1964] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:36.029153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310cf20-0519-4de0-a6c1-5ff929008958 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.029463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310cf20-0519-4de0-a6c1-5ff929008958 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.029885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310cf20-0519-4de0-a6c1-5ff929008958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.051048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9310cf20-0519-4de0-a6c1-5ff929008958 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:36.052333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9310cf20-0519-4de0-a6c1-5ff929008958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:36.060723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 980/1965] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:36.064924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c9d1-b5ea-42a3-b361-3e994da9f322 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:36.076445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c9d1-b5ea-42a3-b361-3e994da9f322 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:36.091388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:36.092100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.092469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.092679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.093496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:36.093796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:36.098195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:36.115488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 986/1966] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:36.119886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310cf20-0519-4de0-a6c1-5ff929008958 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:36.134408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310cf20-0519-4de0-a6c1-5ff929008958 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:36.139822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:36.140560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.140947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.141456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.142289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:36.145186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:36.253912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 981/1967] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:36 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:36.255380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:36.266246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c957a1-6604-4cce-b9e2-e0e815428fff admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:36.333941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:36.334757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.335380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.335380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.336409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:36.339080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:36.438665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 987/1968] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:36 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:36.443045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:36.466245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b5620-dfa8-440d-900d-2788d646c585 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:36.478261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:36.478914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.479260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.479434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.480223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:36.482080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:36.511966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 982/1969] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:36.517393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:36.538721 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b76cbb-db13-4a0d-b901-47e5fc5bd270 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:36.543984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb439f2-77df-4222-ac95-434cf8f7cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:36.544724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb439f2-77df-4222-ac95-434cf8f7cf40 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.545002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb439f2-77df-4222-ac95-434cf8f7cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.545277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb439f2-77df-4222-ac95-434cf8f7cf40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.546012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb439f2-77df-4222-ac95-434cf8f7cf40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:36.547635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb439f2-77df-4222-ac95-434cf8f7cf40 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:36.564461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 988/1970] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:36.568886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:36.580324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100378d-dd91-4c29-b925-c8b2959c8dec admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:36.585156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:36.586094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.586376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.586680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] PATH_INFO: `/v3/projects/17f18f57489345ed97894a52bacb4f25/users/dc7da61c06c748979c0e1bf512bb5416/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.603558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f18f57489345ed97894a52bacb4f25, user_id=dc7da61c06c748979c0e1bf512bb5416, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:36.606015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:36.706418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 983/1971] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:36 2022] PUT /identity/v3/projects/17f18f57489345ed97894a52bacb4f25/users/dc7da61c06c748979c0e1bf512bb5416/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:36.718750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d9072-3ef2-4cdf-b198-a51f21a683b7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.719067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d9072-3ef2-4cdf-b198-a51f21a683b7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.719410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d9072-3ef2-4cdf-b198-a51f21a683b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.747296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-735d9072-3ef2-4cdf-b198-a51f21a683b7 None None] MFA Rules not processed for user `dc7da61c06c748979c0e1bf512bb5416`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:36.748535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-735d9072-3ef2-4cdf-b198-a51f21a683b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:36.814114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 989/1972] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:36.818064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:36.896999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc6527-660f-45e1-b557-c37c7bc2941a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:36.901679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:36.902328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:36.902609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:36.902941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:36.903721 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:36.905598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:37.024485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 984/1973] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:36 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:37.028848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d9072-3ef2-4cdf-b198-a51f21a683b7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:37.040160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d9072-3ef2-4cdf-b198-a51f21a683b7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:37.099795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:37.100477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:37.100816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:37.101088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:37.101795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:37.103795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:37.176627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 990/1974] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:37 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:37.180740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:37.191847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d27fb-0b41-4636-a9fb-67a53c2dece5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:37.196450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:37.197094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:37.197374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:37.197652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:37.198418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:37.200041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:37.211612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 985/1975] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:37.215881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:37.226140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b056-402d-499f-83db-0f781d711661 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:37.230766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:37.231674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:37.232044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:37.232252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] PATH_INFO: `/v3/projects/8af33a7590cf46ac84a4308fc89a69fd/users/6db431bc17604407868eeea7e1cd4f1a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:37.248108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af33a7590cf46ac84a4308fc89a69fd, user_id=6db431bc17604407868eeea7e1cd4f1a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:37.250830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:37.500860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 991/1976] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:37 2022] PUT /identity/v3/projects/8af33a7590cf46ac84a4308fc89a69fd/users/6db431bc17604407868eeea7e1cd4f1a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:37.503260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:37.508012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f48e52-afbc-4e13-94eb-1a5c5bfdccb9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:37.578780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f56d-b66c-4f50-954d-e458b29c47ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:37.579865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f56d-b66c-4f50-954d-e458b29c47ba admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:37.580220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f56d-b66c-4f50-954d-e458b29c47ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:37.580512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f56d-b66c-4f50-954d-e458b29c47ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:37.581280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728f56d-b66c-4f50-954d-e458b29c47ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:37.583035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728f56d-b66c-4f50-954d-e458b29c47ba admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:37.593640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 986/1977] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:37.601487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:37.614032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4f4e-9947-4cc5-8e6e-bffa626976b2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:37.618851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:37.619744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:37.620251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:37.620560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] PATH_INFO: `/v3/projects/8af33a7590cf46ac84a4308fc89a69fd/users/6db431bc17604407868eeea7e1cd4f1a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:37.622543 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af33a7590cf46ac84a4308fc89a69fd, user_id=6db431bc17604407868eeea7e1cd4f1a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:37.625199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:37.637228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 992/1978] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:37 2022] PUT /identity/v3/projects/8af33a7590cf46ac84a4308fc89a69fd/users/6db431bc17604407868eeea7e1cd4f1a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:37.647733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f8b78-6e31-487e-8542-5e3f12070647 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:37.648024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f8b78-6e31-487e-8542-5e3f12070647 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:37.648919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f8b78-6e31-487e-8542-5e3f12070647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:37.677318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-961f8b78-6e31-487e-8542-5e3f12070647 None None] MFA Rules not processed for user `6db431bc17604407868eeea7e1cd4f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:37.678739 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-961f8b78-6e31-487e-8542-5e3f12070647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:37.764684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 987/1979] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:37.896429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:37.899013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:37.961032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7dbe-4656-40cf-9f44-f889ed079314 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:37.964738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:37.970835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:37.970835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:37.970835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:37.976326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:37.977845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:37.988310 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 993/1980] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:38.250648 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f8b78-6e31-487e-8542-5e3f12070647 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:38.261097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f8b78-6e31-487e-8542-5e3f12070647 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:38.268516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b74b-419a-4508-a9c5-d62673433e5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:38.268516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b74b-419a-4508-a9c5-d62673433e5c service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:38.268516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b74b-419a-4508-a9c5-d62673433e5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:38.268516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b74b-419a-4508-a9c5-d62673433e5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:38.322043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443b74b-419a-4508-a9c5-d62673433e5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:38.323575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443b74b-419a-4508-a9c5-d62673433e5c service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:38.333356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 988/1981] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:46:38.537055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:38.538479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:38.607181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59418b70-e1d4-4c40-aba2-9693e8363360 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:38.611818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:38.612682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:38.612962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:38.613234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] PATH_INFO: `/v3/users/ccf6bd596ca7419aa08894ec86df98f1` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:38.614435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf6bd596ca7419aa08894ec86df98f1)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:38.616395 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:38.844933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf6bd596ca7419aa08894ec86df98f1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:38.845673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf6bd596ca7419aa08894ec86df98f1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:38.857324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf6bd596ca7419aa08894ec86df98f1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:38.864079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf6bd596ca7419aa08894ec86df98f1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:38.943753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf6bd596ca7419aa08894ec86df98f1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:38.950173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 994/1982] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:38 2022] DELETE /identity/v3/users/ccf6bd596ca7419aa08894ec86df98f1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:38.954737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:38.955206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:38.955458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:38.972712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:38.973906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:39.034234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 989/1983] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:39.045804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:39.047753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:39.111631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729980-a333-4037-93c6-6a46d917ec9e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:39.115211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:39.115860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:39.116135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:39.116409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:39.125482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:39.127526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:39.137292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 995/1984] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:46:39.528458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:39.530058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:39.543202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422b9e-1586-4713-897a-b53dbfea35a3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:39.555089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:39.556034 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:39.556392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:39.556857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] PATH_INFO: `/v3/projects/b025424891074d1cac77d20e0f9f4693` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:39.559267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b025424891074d1cac77d20e0f9f4693)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:39.562070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:39.697674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b025424891074d1cac77d20e0f9f4693', 'request_id': 'req-5eff80b7-4587-4e46-97f8-f78ea7681c24'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:39.776753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b025424891074d1cac77d20e0f9f4693', 'request_id': 'req-5eff80b7-4587-4e46-97f8-f78ea7681c24'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:39.784347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b025424891074d1cac77d20e0f9f4693', 'request_id': 'req-5eff80b7-4587-4e46-97f8-f78ea7681c24'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:39.794749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] The token cache is being invalidate because project b025424891074d1cac77d20e0f9f4693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:39.795069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:39.795809 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:39.797378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 990/1985] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:39 2022] DELETE /identity/v3/projects/b025424891074d1cac77d20e0f9f4693 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:39.801392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:39.811181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e434bc0-783b-413a-941f-ffeaffcce995 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:39.878421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:39.879507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:39.879800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:39.880078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] PATH_INFO: `/v3/users/2d288206226d4f829d864fcc58e547f5` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:39.881485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d288206226d4f829d864fcc58e547f5)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:39.883778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:40.115974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d288206226d4f829d864fcc58e547f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:40.116639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d288206226d4f829d864fcc58e547f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:40.130715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d288206226d4f829d864fcc58e547f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:40.141443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d288206226d4f829d864fcc58e547f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:40.223998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d288206226d4f829d864fcc58e547f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:40.230299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 996/1986] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:39 2022] DELETE /identity/v3/users/2d288206226d4f829d864fcc58e547f5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:40.831727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:40.831727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:40.842962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff80b7-4587-4e46-97f8-f78ea7681c24 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:40.903076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:40.903935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:40.904237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:40.904511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] PATH_INFO: `/v3/projects/962a52eb8b31484cbd53abded6cf8c56` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:40.905715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] RBAC: Authorizing `identity:delete_project(project_id=962a52eb8b31484cbd53abded6cf8c56)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:40.908054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:41.031651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962a52eb8b31484cbd53abded6cf8c56', 'request_id': 'req-21daf3d3-e107-4b96-a24b-f456ffcc519e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.092465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962a52eb8b31484cbd53abded6cf8c56', 'request_id': 'req-21daf3d3-e107-4b96-a24b-f456ffcc519e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.100219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962a52eb8b31484cbd53abded6cf8c56', 'request_id': 'req-21daf3d3-e107-4b96-a24b-f456ffcc519e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.111181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] The token cache is being invalidate because project 962a52eb8b31484cbd53abded6cf8c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:41.111675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.112337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.114121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 991/1987] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:40 2022] DELETE /identity/v3/projects/962a52eb8b31484cbd53abded6cf8c56 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:41.118657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:41.120099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:41.134286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781264-b0ad-4c5f-801d-8dbbb8cbea84 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:41.189926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:41.190798 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:41.191099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:41.191372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] PATH_INFO: `/v3/users/03d8db609cbd45e8913aeb77ca0d9076` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:41.192631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d8db609cbd45e8913aeb77ca0d9076)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:41.194481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:41.453429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d8db609cbd45e8913aeb77ca0d9076'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.454073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d8db609cbd45e8913aeb77ca0d9076'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.466649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d8db609cbd45e8913aeb77ca0d9076'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.473771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d8db609cbd45e8913aeb77ca0d9076'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.550262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ae05a19e-3633-47dd-a6e1-112d1a121391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d8db609cbd45e8913aeb77ca0d9076'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:41.556972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 997/1988] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:41 2022] DELETE /identity/v3/users/03d8db609cbd45e8913aeb77ca0d9076 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:41.927382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:41.933596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:41.944748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daf3d3-e107-4b96-a24b-f456ffcc519e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:42.024512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:42.025373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.025656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.025933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] PATH_INFO: `/v3/projects/a58204131dc044f0b4e0628810319a06` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.027181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58204131dc044f0b4e0628810319a06)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:42.029106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:42.148635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58204131dc044f0b4e0628810319a06', 'request_id': 'req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:42.210645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58204131dc044f0b4e0628810319a06', 'request_id': 'req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:42.217796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58204131dc044f0b4e0628810319a06', 'request_id': 'req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:42.231515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] The token cache is being invalidate because project a58204131dc044f0b4e0628810319a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:42.231826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:42.232633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b1de03fa-c4ca-4b9f-9c41-d89fb9551cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:42.234436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 992/1989] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:41 2022] DELETE /identity/v3/projects/a58204131dc044f0b4e0628810319a06 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:42.240690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ab02d-d362-4103-b1dd-04030a57d19e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.241204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ab02d-d362-4103-b1dd-04030a57d19e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.248169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ab02d-d362-4103-b1dd-04030a57d19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.261367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ed8ab02d-d362-4103-b1dd-04030a57d19e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:42.262637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ed8ab02d-d362-4103-b1dd-04030a57d19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:42.325651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 998/1990] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:42.334063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c45b46-e5b9-400a-acb1-f049b7da9705 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.334421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c45b46-e5b9-400a-acb1-f049b7da9705 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.334990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c45b46-e5b9-400a-acb1-f049b7da9705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.353401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-12c45b46-e5b9-400a-acb1-f049b7da9705 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:42.354608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-12c45b46-e5b9-400a-acb1-f049b7da9705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:42.363022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 993/1991] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:42.367634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ab02d-d362-4103-b1dd-04030a57d19e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:42.378199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ab02d-d362-4103-b1dd-04030a57d19e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:42.383477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:42.384127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.384406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.384679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.385411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:42.385712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:42.387427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:42.399481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 999/1992] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:42.403865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c45b46-e5b9-400a-acb1-f049b7da9705 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:42.414592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c45b46-e5b9-400a-acb1-f049b7da9705 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:42.419552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:42.420212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.420494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.420765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.421472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:42.423483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:42.524011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 994/1993] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:42 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:42.528197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:42.538451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c0243-0daa-4b07-8edd-af1e353fd519 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:42.603812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:42.604476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.604753 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.605021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.605731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:42.607688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:42.709741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1000/1994] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:42 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:42.714025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:42.725655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d8840-421b-4cac-8431-5fe4ddf9e578 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:42.730385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:42.731200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.731482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.731809 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.732498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:42.734095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:42.745050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 995/1995] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:42.749208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:42.759872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250baf5-54a6-483e-a7dc-6ca0b2ba2b08 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:42.764456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaf532-fed7-462b-9047-466b464b3be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:42.765091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaf532-fed7-462b-9047-466b464b3be7 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.765366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaf532-fed7-462b-9047-466b464b3be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.765633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaf532-fed7-462b-9047-466b464b3be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.766354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaf532-fed7-462b-9047-466b464b3be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:42.768021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaf532-fed7-462b-9047-466b464b3be7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:42.778464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1001/1996] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:42.782427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:42.792686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831e692-56e1-4017-b36a-26073fd59613 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:42.799013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:42.799013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.799013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.799289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] PATH_INFO: `/v3/projects/312aa3bc689a4238bb1aac1160776469/users/1d7540b017f1463cab6d82c67526f197/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.814471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312aa3bc689a4238bb1aac1160776469, user_id=1d7540b017f1463cab6d82c67526f197, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:42.817645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:42.891068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 996/1997] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:42 2022] PUT /identity/v3/projects/312aa3bc689a4238bb1aac1160776469/users/1d7540b017f1463cab6d82c67526f197/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:42.902030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:42.902320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:42.902598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:42.929552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] MFA Rules not processed for user `1d7540b017f1463cab6d82c67526f197`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:42.930763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:43.010067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1002/1998] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:43.032160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:43.035553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:43.103893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d097866-5c2b-47c3-8bd2-8d253c766996 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:43.110125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e308b4-1a88-4e0c-87c7-ef4ce329d6d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72317f5c187c41e9b2d1c53c9cedcd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:43.111554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e308b4-1a88-4e0c-87c7-ef4ce329d6d8 service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:43.112029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e308b4-1a88-4e0c-87c7-ef4ce329d6d8 service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:43.112537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e308b4-1a88-4e0c-87c7-ef4ce329d6d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:43.122579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e308b4-1a88-4e0c-87c7-ef4ce329d6d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:43.124060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e308b4-1a88-4e0c-87c7-ef4ce329d6d8 service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:43.133826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 997/1999] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:43.431909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:43.433323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:43.496529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b03e53-275a-442c-b00f-504ff573e07f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:43.500939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:43.501843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:43.502118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:43.502389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] PATH_INFO: `/v3/users/dc7da61c06c748979c0e1bf512bb5416` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:43.503614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7da61c06c748979c0e1bf512bb5416)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:43.505777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:43.669011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7da61c06c748979c0e1bf512bb5416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:43.669599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7da61c06c748979c0e1bf512bb5416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:43.683533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7da61c06c748979c0e1bf512bb5416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:43.691736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7da61c06c748979c0e1bf512bb5416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:43.789430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7da61c06c748979c0e1bf512bb5416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:43.796022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1003/2000] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:43 2022] DELETE /identity/v3/users/dc7da61c06c748979c0e1bf512bb5416 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:43.800800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:43.801107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:43.801440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:43.819586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:43.820784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:43.879187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 998/2001] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:43.890873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:43.891424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:43.950297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bcf83-c4eb-4527-8494-68ae2bbefc12 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:43.954030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:43.954708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:43.955590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:43.955870 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:43.965563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:43.967055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:43.976947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1004/2002] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:46:44.345176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:44.347339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:44.360599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036f212-15d1-40bd-a2bd-b43db6e236d8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:44.365820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:44.366919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:44.367201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:44.367989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] PATH_INFO: `/v3/projects/17f18f57489345ed97894a52bacb4f25` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:44.369386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f18f57489345ed97894a52bacb4f25)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:44.371414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:44.493291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f18f57489345ed97894a52bacb4f25', 'request_id': 'req-8805eb27-7361-4c54-b0ba-7ad95f9f901d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.532286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f18f57489345ed97894a52bacb4f25', 'request_id': 'req-8805eb27-7361-4c54-b0ba-7ad95f9f901d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.539061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f18f57489345ed97894a52bacb4f25', 'request_id': 'req-8805eb27-7361-4c54-b0ba-7ad95f9f901d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.549717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] The token cache is being invalidate because project 17f18f57489345ed97894a52bacb4f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:44.549996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.550665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.552210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 999/2003] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:44 2022] DELETE /identity/v3/projects/17f18f57489345ed97894a52bacb4f25 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:44.556181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:44.566115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8af6c-9787-45a3-9449-56d5e23ac960 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:44.619941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:44.620741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:44.621017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:44.621288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] PATH_INFO: `/v3/users/6db431bc17604407868eeea7e1cd4f1a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:44.622493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db431bc17604407868eeea7e1cd4f1a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:44.624454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:44.779396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db431bc17604407868eeea7e1cd4f1a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.780062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db431bc17604407868eeea7e1cd4f1a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.791365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db431bc17604407868eeea7e1cd4f1a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.797854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db431bc17604407868eeea7e1cd4f1a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.858105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-66756aea-677f-4c24-9d33-6eac004331a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db431bc17604407868eeea7e1cd4f1a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:44.865164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1005/2004] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:44 2022] DELETE /identity/v3/users/6db431bc17604407868eeea7e1cd4f1a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:45.288086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:45.292248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:45.304554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805eb27-7361-4c54-b0ba-7ad95f9f901d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:45.362338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:45.363226 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:45.363511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:45.363787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] PATH_INFO: `/v3/projects/8af33a7590cf46ac84a4308fc89a69fd` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:45.364973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af33a7590cf46ac84a4308fc89a69fd)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:45.366914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:45.462908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af33a7590cf46ac84a4308fc89a69fd', 'request_id': 'req-ffadbc96-a835-40cc-8048-a6bdf1b77c85'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:45.508921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af33a7590cf46ac84a4308fc89a69fd', 'request_id': 'req-ffadbc96-a835-40cc-8048-a6bdf1b77c85'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:45.515088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af33a7590cf46ac84a4308fc89a69fd', 'request_id': 'req-ffadbc96-a835-40cc-8048-a6bdf1b77c85'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:45.525622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] The token cache is being invalidate because project 8af33a7590cf46ac84a4308fc89a69fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:45.525902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:45.526518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ffadbc96-a835-40cc-8048-a6bdf1b77c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:45.528039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1000/2005] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:45 2022] DELETE /identity/v3/projects/8af33a7590cf46ac84a4308fc89a69fd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:45.534182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060a6f-fc11-4f79-936b-53ab4f052202 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:45.534481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060a6f-fc11-4f79-936b-53ab4f052202 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:45.534812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060a6f-fc11-4f79-936b-53ab4f052202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:45.552426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-53060a6f-fc11-4f79-936b-53ab4f052202 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:45.553607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-53060a6f-fc11-4f79-936b-53ab4f052202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:45.612298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1006/2006] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:45.620920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5a9b6-9d84-42d7-84d9-6cb6404c35d0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:45.621203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5a9b6-9d84-42d7-84d9-6cb6404c35d0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:45.621477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5a9b6-9d84-42d7-84d9-6cb6404c35d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:45.640089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c3b5a9b6-9d84-42d7-84d9-6cb6404c35d0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:45.641269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c3b5a9b6-9d84-42d7-84d9-6cb6404c35d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:45.648901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1001/2007] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:45.652961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060a6f-fc11-4f79-936b-53ab4f052202 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:45.662924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060a6f-fc11-4f79-936b-53ab4f052202 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:45.667478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:45.668113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:45.668392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:45.668664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:45.669392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:45.669692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:45.671332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:45.683182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1007/2008] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:45.687165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5a9b6-9d84-42d7-84d9-6cb6404c35d0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:45.696867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5a9b6-9d84-42d7-84d9-6cb6404c35d0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:45.701455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:45.702080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:45.702355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:45.702623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:45.703350 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:45.705248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:45.796059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1002/2009] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:45 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:45.800500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:45.810506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2421a-8fdf-4af9-b419-f9d1c494e1c2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:45.864542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:45.865196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:45.865476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:45.865752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:45.866459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:45.868415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:45.948939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1008/2010] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:45 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:45.953194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:45.963777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83a5dd-e9b7-4666-b92a-c51a8790c9f5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:45.968298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:45.968951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:45.969228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:45.969500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:45.975653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:45.975653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:45.982571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1003/2011] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:45.987014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:45.997932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94c932-92b5-4f1d-92af-124501d5238f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.006091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c031fc-e1bd-4864-b12e-284c99809cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.006935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c031fc-e1bd-4864-b12e-284c99809cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.007322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c031fc-e1bd-4864-b12e-284c99809cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.007601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c031fc-e1bd-4864-b12e-284c99809cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.008344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c031fc-e1bd-4864-b12e-284c99809cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.009960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c031fc-e1bd-4864-b12e-284c99809cd9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.024622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1009/2012] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:46.025957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.038460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00590f9-0f2b-4b48-83cd-6a2e3dc3a60c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.043179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.044101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.044379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.044671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] PATH_INFO: `/v3/projects/7b03d738caea4fcfa17a872b5673ff7a/users/865ea5ae2a7f4e0890d6961eb586e930/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.060435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b03d738caea4fcfa17a872b5673ff7a, user_id=865ea5ae2a7f4e0890d6961eb586e930, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.063187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.138375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1004/2013] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:46 2022] PUT /identity/v3/projects/7b03d738caea4fcfa17a872b5673ff7a/users/865ea5ae2a7f4e0890d6961eb586e930/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:46.148732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cbfe-4b17-4782-b7cc-939dfb0959f7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.149057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cbfe-4b17-4782-b7cc-939dfb0959f7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.149327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cbfe-4b17-4782-b7cc-939dfb0959f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.179221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3f55cbfe-4b17-4782-b7cc-939dfb0959f7 None None] MFA Rules not processed for user `865ea5ae2a7f4e0890d6961eb586e930`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:46.180651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3f55cbfe-4b17-4782-b7cc-939dfb0959f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:46.251292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1010/2014] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:46.256397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.314632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f408d-b711-4f3d-b5b6-eca5866d28fc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.319753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.321773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.321773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.321773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.321773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.323864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.385705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1005/2015] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:46 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:46.389845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55cbfe-4b17-4782-b7cc-939dfb0959f7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.401972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55cbfe-4b17-4782-b7cc-939dfb0959f7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.458625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.459314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.459595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.459897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.460598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.462518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.543229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1011/2016] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:46 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:46.547238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.557735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22225fc-1b23-4890-98e8-f889cdcf820d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.562410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.563032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.563312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.563587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.564582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.566232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.576370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1006/2017] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:46.580940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.590625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371557e-4201-41d2-a47f-10f34735df4c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.595206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.596737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.597012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.597284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] PATH_INFO: `/v3/projects/331fd00b9ae5439caeb69b6c247ba394/users/fec163e40acb4938ae44b55aa1635d63/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.611372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=331fd00b9ae5439caeb69b6c247ba394, user_id=fec163e40acb4938ae44b55aa1635d63, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.614017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.704554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1012/2018] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:46 2022] PUT /identity/v3/projects/331fd00b9ae5439caeb69b6c247ba394/users/fec163e40acb4938ae44b55aa1635d63/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:46.709302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.719182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3bd4b-1056-4ac1-9dbf-e4233e637ce4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.777141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee43d0-e4f0-4464-85aa-797dd7d4a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.777793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee43d0-e4f0-4464-85aa-797dd7d4a9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.778076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee43d0-e4f0-4464-85aa-797dd7d4a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.778355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee43d0-e4f0-4464-85aa-797dd7d4a9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.779134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee43d0-e4f0-4464-85aa-797dd7d4a9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.780710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee43d0-e4f0-4464-85aa-797dd7d4a9d9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.790531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1007/2019] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:46.794947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.806478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ecfbe-b963-4701-9855-74a680a5bc6a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:46.811216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:46.812091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.812372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.812694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] PATH_INFO: `/v3/projects/331fd00b9ae5439caeb69b6c247ba394/users/fec163e40acb4938ae44b55aa1635d63/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.815178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] RBAC: Authorizing `identity:create_grant(project_id=331fd00b9ae5439caeb69b6c247ba394, user_id=fec163e40acb4938ae44b55aa1635d63, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:46.817837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:46.828504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1013/2020] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:46 2022] PUT /identity/v3/projects/331fd00b9ae5439caeb69b6c247ba394/users/fec163e40acb4938ae44b55aa1635d63/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:46.839429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9bb92-1888-427c-80a8-1cd680fd73c5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:46.839714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9bb92-1888-427c-80a8-1cd680fd73c5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:46.839989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9bb92-1888-427c-80a8-1cd680fd73c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:46.865682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2cf9bb92-1888-427c-80a8-1cd680fd73c5 None None] MFA Rules not processed for user `fec163e40acb4938ae44b55aa1635d63`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:46.866944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2cf9bb92-1888-427c-80a8-1cd680fd73c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:46.934015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1008/2021] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:46.945337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:46.947061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:47.001880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c704e5-0942-4a65-83ca-83857fdc518c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:47.005778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:47.006401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:47.006674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:47.006975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:47.015582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:47.017095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:47.026569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1014/2022] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:47.307678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9bb92-1888-427c-80a8-1cd680fd73c5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:47.318954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9bb92-1888-427c-80a8-1cd680fd73c5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:47.327221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600ee14-08bc-409c-8c97-97adf588342a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:47.327221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ee14-08bc-409c-8c97-97adf588342a service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:47.327386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ee14-08bc-409c-8c97-97adf588342a service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:47.327592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600ee14-08bc-409c-8c97-97adf588342a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:47.392365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ee14-08bc-409c-8c97-97adf588342a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:47.393806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600ee14-08bc-409c-8c97-97adf588342a service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:47.402893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1009/2023] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:52.046500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:52.047946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:52.114290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75ba22-8d37-4420-b86d-56e2c276a43c service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:52.118852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:52.119714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:52.119994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:52.120266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] PATH_INFO: `/v3/users/83494d2fb25f42098ed3094540562f3b` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:52.121487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83494d2fb25f42098ed3094540562f3b)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:52.123441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:52.276002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83494d2fb25f42098ed3094540562f3b'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:52.276655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83494d2fb25f42098ed3094540562f3b'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:52.289414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83494d2fb25f42098ed3094540562f3b'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:52.296188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83494d2fb25f42098ed3094540562f3b'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:52.402447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83494d2fb25f42098ed3094540562f3b'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:52.410511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1015/2024] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:52 2022] DELETE /identity/v3/users/83494d2fb25f42098ed3094540562f3b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:52.420066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:52.420616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:52.420616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:52.441412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:52.442745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:52.516445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1010/2025] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:52.527758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:52.535011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:52.604195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a5fbf-02f9-4172-8897-b217ff94e7f9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:52.608657 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:52.609445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:52.609820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:52.610188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:52.620762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:52.622990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:52.636039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1016/2026] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:53.113200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:53.114626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:53.128785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb891-c0a4-4e98-ae05-41e0a722204f None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:53.138783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:53.139912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:53.140292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:53.140735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] PATH_INFO: `/v3/projects/fcde70f16b77430cb000fd431908c79d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:53.142127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcde70f16b77430cb000fd431908c79d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:53.154313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:53.286598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcde70f16b77430cb000fd431908c79d', 'request_id': 'req-eceb059d-63ed-4b26-ba5e-d43f2ced194f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.353898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcde70f16b77430cb000fd431908c79d', 'request_id': 'req-eceb059d-63ed-4b26-ba5e-d43f2ced194f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.362165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcde70f16b77430cb000fd431908c79d', 'request_id': 'req-eceb059d-63ed-4b26-ba5e-d43f2ced194f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.377706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] The token cache is being invalidate because project fcde70f16b77430cb000fd431908c79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:53.377996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.378829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.380614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1011/2027] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:53 2022] DELETE /identity/v3/projects/fcde70f16b77430cb000fd431908c79d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:53.384436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:53.394884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4e4c8-009c-40f3-9155-e69e78f3168e service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:53.454744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:53.455920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:53.456239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:53.456514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] PATH_INFO: `/v3/users/0c6cf9b35c7c4218953a1dbdc1dbe87d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:53.457795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6cf9b35c7c4218953a1dbdc1dbe87d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:53.459940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:53.648409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6cf9b35c7c4218953a1dbdc1dbe87d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.649081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6cf9b35c7c4218953a1dbdc1dbe87d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.661173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6cf9b35c7c4218953a1dbdc1dbe87d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.667812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6cf9b35c7c4218953a1dbdc1dbe87d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.730512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-57326927-d703-4318-8428-e4d578abbfff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6cf9b35c7c4218953a1dbdc1dbe87d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:53.738319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1017/2028] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:53 2022] DELETE /identity/v3/users/0c6cf9b35c7c4218953a1dbdc1dbe87d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:54.230819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:54.233453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:54.251954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb059d-63ed-4b26-ba5e-d43f2ced194f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:54.317016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:54.317874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:54.318171 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:54.318481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] PATH_INFO: `/v3/projects/aebb99bc596848ad9cf93a19254e8a25` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:54.319735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebb99bc596848ad9cf93a19254e8a25)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:54.321649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:54.509489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebb99bc596848ad9cf93a19254e8a25', 'request_id': 'req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:54.623820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebb99bc596848ad9cf93a19254e8a25', 'request_id': 'req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:54.633652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebb99bc596848ad9cf93a19254e8a25', 'request_id': 'req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:54.648989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] The token cache is being invalidate because project aebb99bc596848ad9cf93a19254e8a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:54.649454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:54.650710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0434cc54-34f2-4cdb-8b6e-edd7aaa9b898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:54.652566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1012/2029] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:54 2022] DELETE /identity/v3/projects/aebb99bc596848ad9cf93a19254e8a25 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:54.660574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fc16-cf9e-4254-b137-154976d806a5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:54.660574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fc16-cf9e-4254-b137-154976d806a5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:54.660574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10fc16-cf9e-4254-b137-154976d806a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:54.684247 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-bb10fc16-cf9e-4254-b137-154976d806a5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:54.686039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-bb10fc16-cf9e-4254-b137-154976d806a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:54.755755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1018/2030] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:54.764452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf3d2-9a49-4626-98f0-88ca44cda767 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:54.768682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf3d2-9a49-4626-98f0-88ca44cda767 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:54.768682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf3d2-9a49-4626-98f0-88ca44cda767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:54.784542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-573cf3d2-9a49-4626-98f0-88ca44cda767 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:54.785777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-573cf3d2-9a49-4626-98f0-88ca44cda767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:54.801145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1013/2031] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:54.805296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10fc16-cf9e-4254-b137-154976d806a5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:54.817062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10fc16-cf9e-4254-b137-154976d806a5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:54.821703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:54.822363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:54.822639 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:54.823154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:54.826821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:54.827403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:54.829051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:54.844068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1019/2032] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:54.859161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf3d2-9a49-4626-98f0-88ca44cda767 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:54.872870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf3d2-9a49-4626-98f0-88ca44cda767 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:54.879100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:54.880074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:54.880352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:54.880623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:54.881341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:54.883500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:54.963967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:54.965708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:54.978397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f579e9-d0eb-4d8d-b186-76e5611d890b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:54.983230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:54.984220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:54.984506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:54.984785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] PATH_INFO: `/v3/users/865ea5ae2a7f4e0890d6961eb586e930` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:54.986615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=865ea5ae2a7f4e0890d6961eb586e930)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:54.988550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:54.994569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1014/2033] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:54 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:54.997499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.060242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3707-39a6-4b2a-97e3-4863e4728064 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.065304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.065963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.066245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.066518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.067267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.069238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.189843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1015/2034] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:54 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:55.193957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.203248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ef41-6a29-42ae-80b2-ffc4e3200ccb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.207920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.208544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.208825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.209100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.209828 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.211440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.224346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1016/2035] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:55.228485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.230658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865ea5ae2a7f4e0890d6961eb586e930'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:55.231516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865ea5ae2a7f4e0890d6961eb586e930'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:55.239531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c6e4-5ecd-4c16-8156-35e629a88466 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.249810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865ea5ae2a7f4e0890d6961eb586e930'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:55.250901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.251762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.252044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.252322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.253077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.255121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.257851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865ea5ae2a7f4e0890d6961eb586e930'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:55.266697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1017/2036] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:55.271155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.283306 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d65f0-83ac-4b0c-abb5-c9ee6f8d8aaf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.292111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7751f-9120-4db9-9dce-16f4fae2e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.293051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7751f-9120-4db9-9dce-16f4fae2e843 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.293328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7751f-9120-4db9-9dce-16f4fae2e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.293598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7751f-9120-4db9-9dce-16f4fae2e843 admin admin] PATH_INFO: `/v3/projects/66a72e5c826c4544877fe6a707df6675/users/87fec3d28ce54c928117e3492e966135/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.312304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7751f-9120-4db9-9dce-16f4fae2e843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a72e5c826c4544877fe6a707df6675, user_id=87fec3d28ce54c928117e3492e966135, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.315762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7751f-9120-4db9-9dce-16f4fae2e843 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.349741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-125497e6-f0ee-4725-809a-f4ea808f0dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865ea5ae2a7f4e0890d6961eb586e930'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:55.356768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1020/2037] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:54 2022] DELETE /identity/v3/users/865ea5ae2a7f4e0890d6961eb586e930 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:55.362167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.362454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.362731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.382472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:55.384126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:55.413409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1018/2038] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:55 2022] PUT /identity/v3/projects/66a72e5c826c4544877fe6a707df6675/users/87fec3d28ce54c928117e3492e966135/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:55.424766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.425053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.425332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.451621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1021/2039] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:55.455300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] MFA Rules not processed for user `87fec3d28ce54c928117e3492e966135`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:55.456557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:55.462404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.463796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:55.524638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1019/2040] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:55.528987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.530959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:55.531480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eb2ed-548a-49f2-baf1-70332ae9b9e8 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.591144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.591980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.592270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.592548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.612315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02c0d6-3131-4828-8667-ef8c468734f8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.618257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.619187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.619698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.620178 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.621150 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.623520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.672078 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.674364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.686970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1022/2041] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:46:55.724810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1020/2042] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:55 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:55.728864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.739280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9c5ba-8c29-47d3-93b0-0d225b374fa4 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.799140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.799782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.800060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.800327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.801035 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.803126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.892667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1023/2043] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:55 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:55.903901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.923061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e6161-c99f-4e32-b59a-485962854b27 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.929439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.930123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.930402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.930676 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.931469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.933079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:55.947638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1021/2044] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:55.951702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:55.962975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34effea3-56b1-4f09-9f8e-198eeff0d8aa admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:55.973045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:55.973984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:55.974259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:55.974531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] PATH_INFO: `/v3/projects/5e01ebc410af479abc8e8871e6a7f9e4/users/0a969d390b814b37803b3b2f2693fc3a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:55.992656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e01ebc410af479abc8e8871e6a7f9e4, user_id=0a969d390b814b37803b3b2f2693fc3a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:55.996939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:56.114693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1024/2045] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:55 2022] PUT /identity/v3/projects/5e01ebc410af479abc8e8871e6a7f9e4/users/0a969d390b814b37803b3b2f2693fc3a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:56.124072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:56.135326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514b220-c99f-4aac-9eb1-0dea7dd7a9bd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:56.145518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:56.147743 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:56.214459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:56.215107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:56.220748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:56.220748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:56.220748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:56.220748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:56.227415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0f9c3-c9ca-4c8a-bf5c-1c9c4124950e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:56.229542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1022/2046] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:56.232676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:56.233628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:56.233997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:56.234118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:56.234470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] PATH_INFO: `/v3/projects/7b03d738caea4fcfa17a872b5673ff7a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:56.237804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b03d738caea4fcfa17a872b5673ff7a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:56.240217 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:56.245075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd0ba2-2ffe-4b84-b99f-2236e36877ee admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:56.250241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2537e-cb00-48c8-8309-243e5b6245df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:56.251262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2537e-cb00-48c8-8309-243e5b6245df admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:56.251733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2537e-cb00-48c8-8309-243e5b6245df admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:56.251999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2537e-cb00-48c8-8309-243e5b6245df admin admin] PATH_INFO: `/v3/projects/5e01ebc410af479abc8e8871e6a7f9e4/users/0a969d390b814b37803b3b2f2693fc3a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:56.254057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2537e-cb00-48c8-8309-243e5b6245df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e01ebc410af479abc8e8871e6a7f9e4, user_id=0a969d390b814b37803b3b2f2693fc3a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:56.257072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2537e-cb00-48c8-8309-243e5b6245df admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:56.270879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1023/2047] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:56 2022] PUT /identity/v3/projects/5e01ebc410af479abc8e8871e6a7f9e4/users/0a969d390b814b37803b3b2f2693fc3a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:56.285409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:56.285815 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:56.286160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:56.313098 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] MFA Rules not processed for user `0a969d390b814b37803b3b2f2693fc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:56.314459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:56.359060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b03d738caea4fcfa17a872b5673ff7a', 'request_id': 'req-bbc5981d-5025-4563-ad52-794158304670'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.364567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b03d738caea4fcfa17a872b5673ff7a', 'request_id': 'req-bbc5981d-5025-4563-ad52-794158304670'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.387843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1024/2048] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:56.398985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:56.400328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:56.429631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b03d738caea4fcfa17a872b5673ff7a', 'request_id': 'req-bbc5981d-5025-4563-ad52-794158304670'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.442837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] The token cache is being invalidate because project 7b03d738caea4fcfa17a872b5673ff7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:56.443355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.444027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.446389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1025/2049] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:56 2022] DELETE /identity/v3/projects/7b03d738caea4fcfa17a872b5673ff7a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:56.451143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:56.452535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:56.474725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d042165-636c-4e40-921b-aa8363dd3e71 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:56.524728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:56.525716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:56.526072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:56.526184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5981d-5025-4563-ad52-794158304670 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:56.526418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:56.528460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:56.531045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:56.531908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:56.532181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:56.532456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] PATH_INFO: `/v3/users/fec163e40acb4938ae44b55aa1635d63` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:56.533843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec163e40acb4938ae44b55aa1635d63)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:56.535914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:56.596294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:56.597851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:56.607857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1025/2050] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:56.635630 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:56.637108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:56.651367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4a86-37df-445f-b2c4-3e79279ce5fe service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:56.656034 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:56.657372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:56.657372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:56.657724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] PATH_INFO: `/v3/users/87fec3d28ce54c928117e3492e966135` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:56.658762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fec3d28ce54c928117e3492e966135)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:56.660730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:56.719066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec163e40acb4938ae44b55aa1635d63'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.720360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec163e40acb4938ae44b55aa1635d63'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.733430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec163e40acb4938ae44b55aa1635d63'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.740568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec163e40acb4938ae44b55aa1635d63'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.823474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7b46bda7-7534-4db9-954f-aa82867dec37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec163e40acb4938ae44b55aa1635d63'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:56.831548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1026/2051] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:56 2022] DELETE /identity/v3/users/fec163e40acb4938ae44b55aa1635d63 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:56.894982 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fec3d28ce54c928117e3492e966135'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.042358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fec3d28ce54c928117e3492e966135'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.043175 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fec3d28ce54c928117e3492e966135'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.043943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fec3d28ce54c928117e3492e966135'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.053047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fec3d28ce54c928117e3492e966135'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.076950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1026/2052] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:56 2022] DELETE /identity/v3/users/87fec3d28ce54c928117e3492e966135 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:57.081533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.081846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.082123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.100618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:57.102492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:57.170596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1027/2053] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:57.185932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:57.187929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:57.252993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1a766-9510-47cb-af97-c865653dc590 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:57.257262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e412916-7a38-47eb-9acf-a15b7979db08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:57.257981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412916-7a38-47eb-9acf-a15b7979db08 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.258333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412916-7a38-47eb-9acf-a15b7979db08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.258671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e412916-7a38-47eb-9acf-a15b7979db08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.269583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412916-7a38-47eb-9acf-a15b7979db08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:57.276969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e412916-7a38-47eb-9acf-a15b7979db08 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:57.281811 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1027/2054] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:46:57.305815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:57.307689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:57.322075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51768ba6-4bf5-467d-84e1-1b53cb52ffb5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:57.327935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:57.328861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.329309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.329993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] PATH_INFO: `/v3/projects/331fd00b9ae5439caeb69b6c247ba394` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.331379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331fd00b9ae5439caeb69b6c247ba394)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:57.345855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:57.452024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331fd00b9ae5439caeb69b6c247ba394', 'request_id': 'req-c81325af-f9d7-4dcb-ae43-76d7ba497e64'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.457286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331fd00b9ae5439caeb69b6c247ba394', 'request_id': 'req-c81325af-f9d7-4dcb-ae43-76d7ba497e64'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.538013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331fd00b9ae5439caeb69b6c247ba394', 'request_id': 'req-c81325af-f9d7-4dcb-ae43-76d7ba497e64'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.555275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] The token cache is being invalidate because project 331fd00b9ae5439caeb69b6c247ba394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:57.555570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.556240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c81325af-f9d7-4dcb-ae43-76d7ba497e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:57.560208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1028/2055] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:57 2022] DELETE /identity/v3/projects/331fd00b9ae5439caeb69b6c247ba394 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:57.566064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9ef9-b2be-4088-adb1-7fc639cf5e25 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.566565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9ef9-b2be-4088-adb1-7fc639cf5e25 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.566872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9ef9-b2be-4088-adb1-7fc639cf5e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.604184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-712d9ef9-b2be-4088-adb1-7fc639cf5e25 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:57.605705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-712d9ef9-b2be-4088-adb1-7fc639cf5e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:57.673898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1028/2056] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:57.682826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7bd8-0092-4489-8c0f-75c8da1154f7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.683133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7bd8-0092-4489-8c0f-75c8da1154f7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.683412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7bd8-0092-4489-8c0f-75c8da1154f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.704191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-10af7bd8-0092-4489-8c0f-75c8da1154f7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:57.706260 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-10af7bd8-0092-4489-8c0f-75c8da1154f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:57.714254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1029/2057] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:57.718439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d9ef9-b2be-4088-adb1-7fc639cf5e25 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:57.729405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d9ef9-b2be-4088-adb1-7fc639cf5e25 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:57.734180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:57.734873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.735152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.735425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.740254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:57.740254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:57.740254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:57.754502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1029/2058] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:46:57.755923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af7bd8-0092-4489-8c0f-75c8da1154f7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:57.768843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af7bd8-0092-4489-8c0f-75c8da1154f7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:57.770664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:57.771352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.771625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.771896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.772611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:57.774488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:57.795489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:57.797201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:57.811010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f1a2-c427-48a0-88a8-b5c4918b21bd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:57.820232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:57.826497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.826497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.826497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] PATH_INFO: `/v3/projects/66a72e5c826c4544877fe6a707df6675` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.826497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a72e5c826c4544877fe6a707df6675)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:57.826497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:57.852692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1030/2059] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:57 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:57.856784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:57.918684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdf8f7-dc0c-4cb4-9654-e8e21bdada7e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:57.923854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:57.924507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:57.924786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:57.925165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:57.925865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:57.927825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:57.965591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a72e5c826c4544877fe6a707df6675', 'request_id': 'req-20eec13d-a0af-4562-867a-c4dce796a222'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.018138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1031/2060] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:57 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:58.018138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:58.030534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb3941-b7d3-4ad6-92db-dc070ebb9ac4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:58.070005 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a72e5c826c4544877fe6a707df6675', 'request_id': 'req-20eec13d-a0af-4562-867a-c4dce796a222'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.099762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a72e5c826c4544877fe6a707df6675', 'request_id': 'req-20eec13d-a0af-4562-867a-c4dce796a222'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.101785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:58.101785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.101986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.104980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.104980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:58.104980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:58.111546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] The token cache is being invalidate because project 66a72e5c826c4544877fe6a707df6675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:58.111833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.112510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.114345 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1030/2061] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:57 2022] DELETE /identity/v3/projects/66a72e5c826c4544877fe6a707df6675 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:58.116800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1032/2062] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:58.118163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:58.120034 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:58.120512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:58.122278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:58.133426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eec13d-a0af-4562-867a-c4dce796a222 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:58.136478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560d31-d6d5-40e8-b50d-c402c3f88721 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:58.148082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:58.148082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.148082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.148082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] PATH_INFO: `/v3/users/0a969d390b814b37803b3b2f2693fc3a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.148511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a969d390b814b37803b3b2f2693fc3a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:58.148599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:58.148599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.148599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.148822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:58.148913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.148913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:58.148913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:58.160265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1033/2063] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:46:58.164733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:58.176137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d656548-3d60-49f9-892a-bbe1501efefc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:58.181891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042ce33-ace1-4ece-875f-404d5fa03339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:58.182664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042ce33-ace1-4ece-875f-404d5fa03339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.182980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042ce33-ace1-4ece-875f-404d5fa03339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.183258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042ce33-ace1-4ece-875f-404d5fa03339 admin admin] PATH_INFO: `/v3/projects/15338340751e435eaa8694c88ced6c2d/users/d22e657c464a42f580afc3e07144e068/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.199793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042ce33-ace1-4ece-875f-404d5fa03339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15338340751e435eaa8694c88ced6c2d, user_id=d22e657c464a42f580afc3e07144e068, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:58.202608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042ce33-ace1-4ece-875f-404d5fa03339 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:58.253015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1034/2064] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:58 2022] PUT /identity/v3/projects/15338340751e435eaa8694c88ced6c2d/users/d22e657c464a42f580afc3e07144e068/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:58.254887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dcc9a-09c3-4311-93c9-bb1814f9f90b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.255547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dcc9a-09c3-4311-93c9-bb1814f9f90b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.255960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dcc9a-09c3-4311-93c9-bb1814f9f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.275287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b56dcc9a-09c3-4311-93c9-bb1814f9f90b None None] MFA Rules not processed for user `6a6f7f126c2a4cbe80f029f352c4cafd`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:58.278831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b56dcc9a-09c3-4311-93c9-bb1814f9f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:58.304422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a969d390b814b37803b3b2f2693fc3a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.332043 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1035/2065] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:58.333442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.333752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.334081 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.352708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:58.353910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:58.383628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a969d390b814b37803b3b2f2693fc3a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.384517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a969d390b814b37803b3b2f2693fc3a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.385234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a969d390b814b37803b3b2f2693fc3a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.394351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a969d390b814b37803b3b2f2693fc3a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:58.413674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1036/2066] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:58.416804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1031/2067] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:58 2022] DELETE /identity/v3/users/0a969d390b814b37803b3b2f2693fc3a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:58.426611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:58.428147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:58.487166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c62832-759b-479b-b6e1-955d7197d741 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:58.537624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a7f1c-7bfd-4c2f-99ef-2cb8fee62650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:58.538847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7f1c-7bfd-4c2f-99ef-2cb8fee62650 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.539204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7f1c-7bfd-4c2f-99ef-2cb8fee62650 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.539478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a7f1c-7bfd-4c2f-99ef-2cb8fee62650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.613880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a7f1c-7bfd-4c2f-99ef-2cb8fee62650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:58.615514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a7f1c-7bfd-4c2f-99ef-2cb8fee62650 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:58.631036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1037/2068] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:46:58.841675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:58.843213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:58.857124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a024e1-f2c6-4d46-8839-8b9bcf47c0bd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:58.862905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:58.864036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:58.864489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:58.864916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] PATH_INFO: `/v3/projects/5e01ebc410af479abc8e8871e6a7f9e4` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:58.866650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e01ebc410af479abc8e8871e6a7f9e4)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:58.868969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:58.978969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e01ebc410af479abc8e8871e6a7f9e4', 'request_id': 'req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.069944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e01ebc410af479abc8e8871e6a7f9e4', 'request_id': 'req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.083497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e01ebc410af479abc8e8871e6a7f9e4', 'request_id': 'req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.109363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] The token cache is being invalidate because project 5e01ebc410af479abc8e8871e6a7f9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:46:59.109848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.113076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf0677e0-d8cf-4e82-935a-1953bc3a0a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.116110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1032/2069] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:46:58 2022] DELETE /identity/v3/projects/5e01ebc410af479abc8e8871e6a7f9e4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:46:59.121270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75154199-1710-4a35-942d-172a81e754d6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.122025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75154199-1710-4a35-942d-172a81e754d6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.122025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75154199-1710-4a35-942d-172a81e754d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.144330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-75154199-1710-4a35-942d-172a81e754d6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:59.145602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-75154199-1710-4a35-942d-172a81e754d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:59.226613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1038/2070] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:59.235414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd5e6-5b34-4f86-b97f-75b183d30e3b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.236324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd5e6-5b34-4f86-b97f-75b183d30e3b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.237191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd5e6-5b34-4f86-b97f-75b183d30e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.258718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c67fd5e6-5b34-4f86-b97f-75b183d30e3b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:59.260085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c67fd5e6-5b34-4f86-b97f-75b183d30e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:59.271869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1033/2071] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:46:59.275658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75154199-1710-4a35-942d-172a81e754d6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.286468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75154199-1710-4a35-942d-172a81e754d6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:59.293586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:59.294185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.294465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.294739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.295535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:46:59.295836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:59.297507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:59.315880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1039/2072] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:46:59.320313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fd5e6-5b34-4f86-b97f-75b183d30e3b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.331051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fd5e6-5b34-4f86-b97f-75b183d30e3b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:59.338937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:59.339877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.340371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.340734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.341649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:59.343867 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:59.444151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1034/2073] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:59 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:46:59.448283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.478464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876749de-a1d3-41af-b004-39234b76f41b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:59.575755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:59.576652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.577017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.577376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.578212 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:59.581322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:59.667669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1040/2074] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:46:59 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:46:59.672214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.672376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.675165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:59.683426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6e3dc-aa09-4d50-9527-ec007213528c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:59.690908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:59.691642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.692119 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.692438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.693262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:59.695330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:59.704000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514cf67-300c-488a-9237-ffc2d6ca1fca admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:59.708750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1041/2075] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:59.712340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.718037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:59.721197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.721732 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.722572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc91c-28b2-4d34-9d56-5e0e694952a0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:59.723206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] PATH_INFO: `/v3/users/b07cb89be4584e6b97df973c88daa6c5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.724669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07cb89be4584e6b97df973c88daa6c5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:59.726958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:59.727934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:59.728583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.728900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.729166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.729933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:59.731628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:59.742521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1042/2076] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:46:59.746676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.757903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef5308-0dc7-4a4d-8d62-72d1de28aa50 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:46:59.762877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fb160-855e-4713-9783-300ea5bd3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:46:59.763905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fb160-855e-4713-9783-300ea5bd3f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.764192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fb160-855e-4713-9783-300ea5bd3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.764552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fb160-855e-4713-9783-300ea5bd3f1d admin admin] PATH_INFO: `/v3/projects/521845c16ce749a195af03ccaf894014/users/11aa4896a2994cadbe2fe61b8b272dda/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.779751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fb160-855e-4713-9783-300ea5bd3f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=521845c16ce749a195af03ccaf894014, user_id=11aa4896a2994cadbe2fe61b8b272dda, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:46:59.782697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fb160-855e-4713-9783-300ea5bd3f1d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:46:59.841142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1043/2077] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:46:59 2022] PUT /identity/v3/projects/521845c16ce749a195af03ccaf894014/users/11aa4896a2994cadbe2fe61b8b272dda/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:46:59.851328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c272a1-b0f5-431a-bd65-51264209215c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:46:59.851614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c272a1-b0f5-431a-bd65-51264209215c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:46:59.851889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c272a1-b0f5-431a-bd65-51264209215c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:46:59.881295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-56c272a1-b0f5-431a-bd65-51264209215c None None] MFA Rules not processed for user `11aa4896a2994cadbe2fe61b8b272dda`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:46:59.882533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-56c272a1-b0f5-431a-bd65-51264209215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:46:59.895308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07cb89be4584e6b97df973c88daa6c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.949426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07cb89be4584e6b97df973c88daa6c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.950086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07cb89be4584e6b97df973c88daa6c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.950774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07cb89be4584e6b97df973c88daa6c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.956754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1044/2078] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:46:59.960258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c272a1-b0f5-431a-bd65-51264209215c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:46:59.962727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07cb89be4584e6b97df973c88daa6c5'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:46:59.988191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1035/2079] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:46:59 2022] DELETE /identity/v3/users/b07cb89be4584e6b97df973c88daa6c5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:00.043683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c272a1-b0f5-431a-bd65-51264209215c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.134057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.137153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.137153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.137153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.137153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.138232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.254845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1045/2080] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:46:59 2022] POST /identity/v3/projects => generated 381 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:00.258576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.260655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:00.282953 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b978a-1c56-4c7f-b7fc-96b0c2eb808b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.345315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d738-3ee4-4f74-b73a-dcff10361c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.346043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d738-3ee4-4f74-b73a-dcff10361c95 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.346496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d738-3ee4-4f74-b73a-dcff10361c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.346818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d738-3ee4-4f74-b73a-dcff10361c95 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.351726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d738-3ee4-4f74-b73a-dcff10361c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.351726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d738-3ee4-4f74-b73a-dcff10361c95 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.378538 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.380685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:00.394413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbaa84-6e91-4500-9cf7-2e9dd4366ecb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.399279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.400191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.400550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.400732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] PATH_INFO: `/v3/projects/3cc69e55b9254a6ba45b32be8fc0df66` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.402329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc69e55b9254a6ba45b32be8fc0df66)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.404394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.482590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1036/2081] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:47:00 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:00.484166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71701a86-49bd-4367-8734-8c133b60bb7e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.484652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71701a86-49bd-4367-8734-8c133b60bb7e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.485075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71701a86-49bd-4367-8734-8c133b60bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.521489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc69e55b9254a6ba45b32be8fc0df66', 'request_id': 'req-0fdd556f-4873-4755-a580-91ac4dff45df'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:00.529339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc69e55b9254a6ba45b32be8fc0df66', 'request_id': 'req-0fdd556f-4873-4755-a580-91ac4dff45df'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:00.536390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-71701a86-49bd-4367-8734-8c133b60bb7e None None] MFA Rules not processed for user `d22e657c464a42f580afc3e07144e068`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:00.537298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-71701a86-49bd-4367-8734-8c133b60bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:00.611078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1037/2082] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:00.613274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71701a86-49bd-4367-8734-8c133b60bb7e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.623930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc69e55b9254a6ba45b32be8fc0df66', 'request_id': 'req-0fdd556f-4873-4755-a580-91ac4dff45df'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:00.639136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] The token cache is being invalidate because project 3cc69e55b9254a6ba45b32be8fc0df66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:47:00.639568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:00.640495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:00.643051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1046/2083] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:47:00 2022] DELETE /identity/v3/projects/3cc69e55b9254a6ba45b32be8fc0df66 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:47:00.643948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.645453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:00.690113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71701a86-49bd-4367-8734-8c133b60bb7e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.695779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a41d08-69eb-4645-b536-201b43a6601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.696658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a41d08-69eb-4645-b536-201b43a6601a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.697209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a41d08-69eb-4645-b536-201b43a6601a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.697661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a41d08-69eb-4645-b536-201b43a6601a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.698554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a41d08-69eb-4645-b536-201b43a6601a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.700538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a41d08-69eb-4645-b536-201b43a6601a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.712671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1038/2084] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:00.714347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.714704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.715059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.731509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd556f-4873-4755-a580-91ac4dff45df admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.736902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ba982-d337-4a80-8b77-8db94e8fb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.737843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba982-d337-4a80-8b77-8db94e8fb960 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.737843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba982-d337-4a80-8b77-8db94e8fb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.738110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ba982-d337-4a80-8b77-8db94e8fb960 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.738703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:00.738839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ba982-d337-4a80-8b77-8db94e8fb960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.740217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:00.742594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ba982-d337-4a80-8b77-8db94e8fb960 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.748670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1039/2085] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:00.749451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.750747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:00.763028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f515ac-f72c-4d30-ab51-b5ed182d7311 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.769038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.770167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.770443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.770767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] PATH_INFO: `/v3/projects/16e82cb3b1e94a819a6d97338df0b023/users/a2e89b8492ee4701b2dea273d553c47a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.786396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e82cb3b1e94a819a6d97338df0b023, user_id=a2e89b8492ee4701b2dea273d553c47a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.789141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.841144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1047/2086] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:47:00 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:00.841144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc77ff-b25f-4726-9c1b-a950eca10ff9 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.841144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc77ff-b25f-4726-9c1b-a950eca10ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.841144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc77ff-b25f-4726-9c1b-a950eca10ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.858363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f3bc77ff-b25f-4726-9c1b-a950eca10ff9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:00.859641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f3bc77ff-b25f-4726-9c1b-a950eca10ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:00.863840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1040/2087] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:00 2022] PUT /identity/v3/projects/16e82cb3b1e94a819a6d97338df0b023/users/a2e89b8492ee4701b2dea273d553c47a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:00.864865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.922388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1048/2088] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:00.924004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc77ff-b25f-4726-9c1b-a950eca10ff9 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.932117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c46a9-d570-417d-aa1a-26d80037d397 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.933322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc77ff-b25f-4726-9c1b-a950eca10ff9 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.937853 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.938487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.939782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.939782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.940530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.941334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b551be7-bc86-49aa-9beb-9330c176fa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.942049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551be7-bc86-49aa-9beb-9330c176fa6a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.942171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.942387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551be7-bc86-49aa-9beb-9330c176fa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.942698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551be7-bc86-49aa-9beb-9330c176fa6a admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.943438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b551be7-bc86-49aa-9beb-9330c176fa6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.947985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b551be7-bc86-49aa-9beb-9330c176fa6a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.964048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1049/2089] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:00.965113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:00.975057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84fe96-1fb5-45f8-afe8-02923934b79c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:00.979626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:00.980237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:00.980514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:00.980784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:00.981497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:47:00.981796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:00.983402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:00.997097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1050/2090] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:47:00.997097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.008099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d89a2-058b-4689-83df-e12772882f75 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.012886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.013740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.014022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.014331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] PATH_INFO: `/v3/projects/16e82cb3b1e94a819a6d97338df0b023/users/a2e89b8492ee4701b2dea273d553c47a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.016530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e82cb3b1e94a819a6d97338df0b023, user_id=a2e89b8492ee4701b2dea273d553c47a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.020201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.031225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1051/2091] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:00 2022] PUT /identity/v3/projects/16e82cb3b1e94a819a6d97338df0b023/users/a2e89b8492ee4701b2dea273d553c47a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:01.032012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.051775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1041/2092] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:47:00 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:01.052871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba1423-b843-442d-b773-9e3f9ab541fb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.053497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba1423-b843-442d-b773-9e3f9ab541fb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.053497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba1423-b843-442d-b773-9e3f9ab541fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.086336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-89ba1423-b843-442d-b773-9e3f9ab541fb None None] MFA Rules not processed for user `a2e89b8492ee4701b2dea273d553c47a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:01.087653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-89ba1423-b843-442d-b773-9e3f9ab541fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:01.100401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d004e-1f95-490c-a99e-20fe0d291799 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.105334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.106004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.106265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.106533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.108213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.109275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.165237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1042/2093] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:01.166162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba1423-b843-442d-b773-9e3f9ab541fb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.178384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba1423-b843-442d-b773-9e3f9ab541fb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.183598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.184252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.184531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.184801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.185542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.187186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.194855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1052/2094] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:47:01 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:01.194855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.197047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:01.203872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1043/2095] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:01.203872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.214585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090861d6-8928-4580-86a6-e7e28950bbd6 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.259831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc6cc-a113-4170-b794-2f8a5eac5a76 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.264167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.264882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.265229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.265500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.303252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.303926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.304248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.304531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.306416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.308662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.375760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.377508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.388400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1053/2096] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:47:01.389400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.399779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2bd4f-ac54-4510-8e5a-a4d5d4197592 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.404286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.405136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.405410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.405675 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] PATH_INFO: `/v3/projects/9d1baec79304448ab95018417941f551/users/6c8e530c335f404f8d45ba8541be7f5f/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.417188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1044/2097] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:47:01 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:01.421738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.426387 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1baec79304448ab95018417941f551, user_id=6c8e530c335f404f8d45ba8541be7f5f, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.429221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.432318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0e3c-3c94-434d-9c86-001664949ef0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.437218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.437941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.438379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.438707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.439481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.441240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.451296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1045/2098] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:47:01.455806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.465032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36306e7-0e43-4e24-9a1a-57920da0fcc3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.469671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.470981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.471263 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.471532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.472249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.473795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.486832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1046/2099] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:47:01.489193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.499877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03240306-199b-4c16-afae-0de0d9e95784 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.505903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e19ed6-a540-4487-b4fb-3342fa95ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.505903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e19ed6-a540-4487-b4fb-3342fa95ab2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.509239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e19ed6-a540-4487-b4fb-3342fa95ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.509239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e19ed6-a540-4487-b4fb-3342fa95ab2d admin admin] PATH_INFO: `/v3/projects/3dfe36d08de049af88fd724e90fbb0d5/users/e72e8f061290417f8b8a4bb8a0d9d2c1/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.521556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e19ed6-a540-4487-b4fb-3342fa95ab2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfe36d08de049af88fd724e90fbb0d5, user_id=e72e8f061290417f8b8a4bb8a0d9d2c1, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.524255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e19ed6-a540-4487-b4fb-3342fa95ab2d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.531318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1054/2100] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:01 2022] PUT /identity/v3/projects/9d1baec79304448ab95018417941f551/users/6c8e530c335f404f8d45ba8541be7f5f/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:01.535899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.599568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1047/2101] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:01 2022] PUT /identity/v3/projects/3dfe36d08de049af88fd724e90fbb0d5/users/e72e8f061290417f8b8a4bb8a0d9d2c1/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:01.609065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.609065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.609065 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.609300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e92ca-24fb-4aa6-9c73-342ff8bc84db admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.631242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:01.632489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:01.673157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.674071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.674358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.674655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.675447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.677090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.687093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1055/2102] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:47:01.695006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.703952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1048/2103] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:01.705690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4179e1-8091-4c6b-a121-3485dd1b04d5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.715696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.717076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:01.717597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.718723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.719323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.720651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] PATH_INFO: `/v3/projects/9d1baec79304448ab95018417941f551/users/6c8e530c335f404f8d45ba8541be7f5f/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.723490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1baec79304448ab95018417941f551, user_id=6c8e530c335f404f8d45ba8541be7f5f, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.726700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.740975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1056/2104] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:01 2022] PUT /identity/v3/projects/9d1baec79304448ab95018417941f551/users/6c8e530c335f404f8d45ba8541be7f5f/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:47:01.801959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bff99b-6806-48ce-bdd6-981a113e5289 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.859740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac1611-e2c4-43bb-98fa-d8208c08c61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.860394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac1611-e2c4-43bb-98fa-d8208c08c61a service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.860851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac1611-e2c4-43bb-98fa-d8208c08c61a service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.861300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac1611-e2c4-43bb-98fa-d8208c08c61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.915097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:01.958276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac1611-e2c4-43bb-98fa-d8208c08c61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.959849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac1611-e2c4-43bb-98fa-d8208c08c61a service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:01.971823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1049/2105] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:47:01.986717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75476-a028-4e78-b851-b10cfeba2c1a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:01.991553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:01.992476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:01.992751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:01.993021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] PATH_INFO: `/v3/users/11aa4896a2994cadbe2fe61b8b272dda` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:01.994444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11aa4896a2994cadbe2fe61b8b272dda)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:01.996600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:02.248044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11aa4896a2994cadbe2fe61b8b272dda'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:02.248712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11aa4896a2994cadbe2fe61b8b272dda'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:02.264182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11aa4896a2994cadbe2fe61b8b272dda'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:02.272556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11aa4896a2994cadbe2fe61b8b272dda'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:02.343852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11aa4896a2994cadbe2fe61b8b272dda'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:02.358970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1057/2106] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:47:01 2022] DELETE /identity/v3/users/11aa4896a2994cadbe2fe61b8b272dda => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:02.361261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:02.361556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:02.361930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:02.386904 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:02.388339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:02.462429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1050/2107] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:02.477352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:02.479090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:02.553563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17322345-bbf5-40e4-ad29-00840eb10ea9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:02.567163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa5b27-f28d-44de-98db-5d3686443a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:02.571087 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa5b27-f28d-44de-98db-5d3686443a24 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:02.571601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa5b27-f28d-44de-98db-5d3686443a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:02.572412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa5b27-f28d-44de-98db-5d3686443a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:02.585443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa5b27-f28d-44de-98db-5d3686443a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:02.587888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa5b27-f28d-44de-98db-5d3686443a24 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:02.601124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1058/2108] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:47:03.268949 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:03.270389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:03.283458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c71cc7-843a-4805-98c1-dae3743c4f94 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:03.290674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:03.291649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:03.292037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:03.292388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] PATH_INFO: `/v3/projects/521845c16ce749a195af03ccaf894014` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:03.293798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=521845c16ce749a195af03ccaf894014)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:03.296033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:03.471191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521845c16ce749a195af03ccaf894014', 'request_id': 'req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.504550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:03.508167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:03.508167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:03.549932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] MFA Rules not processed for user `6c8e530c335f404f8d45ba8541be7f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:03.551730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:03.555449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521845c16ce749a195af03ccaf894014', 'request_id': 'req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.562543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521845c16ce749a195af03ccaf894014', 'request_id': 'req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.576290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] The token cache is being invalidate because project 521845c16ce749a195af03ccaf894014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:47:03.576584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.577252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.578873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1051/2109] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:47:03 2022] DELETE /identity/v3/projects/521845c16ce749a195af03ccaf894014 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:47:03.583051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:03.584668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:03.696968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa50df-ca40-4fdb-83e2-4afe12a57a7e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:03.703488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1059/2110] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:47:03.713219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:03.714102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:03.714715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:03.715215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] PATH_INFO: `/v3/users/a2e89b8492ee4701b2dea273d553c47a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:03.717243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e89b8492ee4701b2dea273d553c47a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:03.722655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:03.731404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:03.736121 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:03.801422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd437c0-42fe-4849-a201-048487f11b6e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:03.805345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:03.806097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:03.806376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:03.806680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:03.811766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:03.920157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e89b8492ee4701b2dea273d553c47a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.932344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:03.933802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:03.952253 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1060/2111] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:47:03.995625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e89b8492ee4701b2dea273d553c47a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.997044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e89b8492ee4701b2dea273d553c47a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:03.998379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e89b8492ee4701b2dea273d553c47a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:04.011196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5559eb79-527b-47f5-933f-712a8f3d50f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e89b8492ee4701b2dea273d553c47a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:04.034317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1052/2112] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:47:03 2022] DELETE /identity/v3/users/a2e89b8492ee4701b2dea273d553c47a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:47:05.115958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:05.144015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3751a0-4197-4515-a596-84df7c770159 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:05.236988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:05.237849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:05.238141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:05.238448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] PATH_INFO: `/v3/projects/16e82cb3b1e94a819a6d97338df0b023` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:05.239671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e82cb3b1e94a819a6d97338df0b023)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:05.241744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:05.356779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e82cb3b1e94a819a6d97338df0b023', 'request_id': 'req-c6ef4658-8710-49c4-9f5a-274527195407'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:05.363038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e82cb3b1e94a819a6d97338df0b023', 'request_id': 'req-c6ef4658-8710-49c4-9f5a-274527195407'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:05.481154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e82cb3b1e94a819a6d97338df0b023', 'request_id': 'req-c6ef4658-8710-49c4-9f5a-274527195407'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:05.493886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] The token cache is being invalidate because project 16e82cb3b1e94a819a6d97338df0b023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:47:05.494176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:05.494834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-c6ef4658-8710-49c4-9f5a-274527195407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:05.496406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1061/2113] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:47:05 2022] DELETE /identity/v3/projects/16e82cb3b1e94a819a6d97338df0b023 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:05.502804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c769-ce04-40ff-94de-a33638725356 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:05.503381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c769-ce04-40ff-94de-a33638725356 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:05.503477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6c769-ce04-40ff-94de-a33638725356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:05.525572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b2a6c769-ce04-40ff-94de-a33638725356 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:05.526858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b2a6c769-ce04-40ff-94de-a33638725356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:05.626110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1053/2114] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:05.635001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7549488-e6e1-472a-b780-8e98822c63f4 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:05.635295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7549488-e6e1-472a-b780-8e98822c63f4 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:05.635577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7549488-e6e1-472a-b780-8e98822c63f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:05.656901 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a7549488-e6e1-472a-b780-8e98822c63f4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:05.659650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a7549488-e6e1-472a-b780-8e98822c63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:05.669026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1062/2115] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:05.674344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c769-ce04-40ff-94de-a33638725356 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:05.685613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6c769-ce04-40ff-94de-a33638725356 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:05.692430 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:05.692996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:05.693288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:05.693561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:05.694508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:47:05.695002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:05.696794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:05.714541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7549488-e6e1-472a-b780-8e98822c63f4 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:05.722591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1054/2116] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:47:05.725545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7549488-e6e1-472a-b780-8e98822c63f4 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:05.731369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:05.732137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:05.732523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:05.733034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:05.733863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:05.736091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:05.843382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1063/2117] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:47:05 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:47:05.845320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:05.855718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35d36-760f-4be6-94cd-89968bfe04be admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:05.947437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:05.948366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:05.948790 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:05.949232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:05.950083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:05.952494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:06.031838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1055/2118] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:47:05 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:06.034785 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:06.045812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25616-ff46-45d8-9ed9-8a5db823b035 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:06.052550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:06.053291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:06.053571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:06.053941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:06.054635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:06.056364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:06.094079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1064/2119] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:06.101706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:06.119396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec09aa-4b11-47af-9039-8fdeb57f0b57 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:06.125250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330d7a3-7c42-48b5-8dd1-8548ed2cfc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:06.126986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d7a3-7c42-48b5-8dd1-8548ed2cfc9d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:06.127497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d7a3-7c42-48b5-8dd1-8548ed2cfc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:06.128031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330d7a3-7c42-48b5-8dd1-8548ed2cfc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:06.128935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330d7a3-7c42-48b5-8dd1-8548ed2cfc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:06.131205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330d7a3-7c42-48b5-8dd1-8548ed2cfc9d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:06.144332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1056/2120] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:06.149062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:06.165597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8206c-8eae-4fa1-b65e-8766a28d6cb5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:06.173513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:06.174585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:06.174936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:06.175339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] PATH_INFO: `/v3/projects/cb13dbc51fbf456ebb6549d9c06770a4/users/5d52bd077a7746ebaf56cc4fa1144f32/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:06.199776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb13dbc51fbf456ebb6549d9c06770a4, user_id=5d52bd077a7746ebaf56cc4fa1144f32, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:06.203139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:06.287935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1065/2121] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:06 2022] PUT /identity/v3/projects/cb13dbc51fbf456ebb6549d9c06770a4/users/5d52bd077a7746ebaf56cc4fa1144f32/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:06.289489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6424a0-4a22-4bdb-90a7-2666167df1d2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:06.290026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6424a0-4a22-4bdb-90a7-2666167df1d2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:06.291491 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6424a0-4a22-4bdb-90a7-2666167df1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:06.358142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bb6424a0-4a22-4bdb-90a7-2666167df1d2 None None] MFA Rules not processed for user `5d52bd077a7746ebaf56cc4fa1144f32`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:06.362597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bb6424a0-4a22-4bdb-90a7-2666167df1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:06.544117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1057/2122] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:06.553623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:06.555856 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:06.632851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4e4e6-8f47-469b-855e-93b3a4105198 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:06.639380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:06.640324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:06.641530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:06.642837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:06.654305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:06.656032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:06.668630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1066/2123] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:47:06.693698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6424a0-4a22-4bdb-90a7-2666167df1d2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:06.782189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6424a0-4a22-4bdb-90a7-2666167df1d2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:06.789162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:06.791641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:06.792519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:06.793172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] PATH_INFO: `/v3/users/5d52bd077a7746ebaf56cc4fa1144f32` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:06.795359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d52bd077a7746ebaf56cc4fa1144f32)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:06.801179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:06.930463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:06.939401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ea2c8-468a-4ad0-9bd5-176b49b12190 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:06.944892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c150e-94dc-41d3-8c59-cc237154e462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:06.945593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c150e-94dc-41d3-8c59-cc237154e462 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:06.945897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c150e-94dc-41d3-8c59-cc237154e462 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:06.946159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c150e-94dc-41d3-8c59-cc237154e462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:06.950036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e03c150e-94dc-41d3-8c59-cc237154e462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:06.969068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d52bd077a7746ebaf56cc4fa1144f32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:07.021876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c150e-94dc-41d3-8c59-cc237154e462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:07.023472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c150e-94dc-41d3-8c59-cc237154e462 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:07.034965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1067/2124] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:47:07.039148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d52bd077a7746ebaf56cc4fa1144f32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:07.039846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d52bd077a7746ebaf56cc4fa1144f32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:07.040418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d52bd077a7746ebaf56cc4fa1144f32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:07.051215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d52bd077a7746ebaf56cc4fa1144f32'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:07.081380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1058/2125] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:47:06 2022] DELETE /identity/v3/users/5d52bd077a7746ebaf56cc4fa1144f32 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:07.087055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:07.088905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:07.088905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:07.107589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:07.108833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:07.185107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1068/2126] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:07.192054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:07.193447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:07.276539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f870b-4590-4b77-a077-24ea8f28fd3b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:07.280237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0af3d-a702-4ab4-b65b-5974b5dac7e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:07.281232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0af3d-a702-4ab4-b65b-5974b5dac7e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:07.281516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0af3d-a702-4ab4-b65b-5974b5dac7e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:07.281788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0af3d-a702-4ab4-b65b-5974b5dac7e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:07.291472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0af3d-a702-4ab4-b65b-5974b5dac7e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:07.296771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0af3d-a702-4ab4-b65b-5974b5dac7e7 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:07.303580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1059/2127] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:47:07.872545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:07.874969 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:07.890514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60415245-69c8-4935-bf45-fa51ee12eaa5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:07.896854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:07.898852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:07.899332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:07.899788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] PATH_INFO: `/v3/projects/cb13dbc51fbf456ebb6549d9c06770a4` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:07.901373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb13dbc51fbf456ebb6549d9c06770a4)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:07.904143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:08.046827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb13dbc51fbf456ebb6549d9c06770a4', 'request_id': 'req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:08.054030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb13dbc51fbf456ebb6549d9c06770a4', 'request_id': 'req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:08.120982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb13dbc51fbf456ebb6549d9c06770a4', 'request_id': 'req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:08.135862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] The token cache is being invalidate because project cb13dbc51fbf456ebb6549d9c06770a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:47:08.136149 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:08.136832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-273c8a6f-66ef-4d75-b5a0-3c12ea7f6723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:08.142677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1069/2128] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:47:07 2022] DELETE /identity/v3/projects/cb13dbc51fbf456ebb6549d9c06770a4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:08.145064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3318aaf-f7ef-44d0-8039-f38c8636050c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:08.150608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3318aaf-f7ef-44d0-8039-f38c8636050c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:08.150608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3318aaf-f7ef-44d0-8039-f38c8636050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:08.166323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a3318aaf-f7ef-44d0-8039-f38c8636050c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:08.167571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a3318aaf-f7ef-44d0-8039-f38c8636050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:08.264209 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1060/2129] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:47:08.265653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4fc84-6350-45b9-adb2-d114e5295c00 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:08.266118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4fc84-6350-45b9-adb2-d114e5295c00 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:08.266271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4fc84-6350-45b9-adb2-d114e5295c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:08.294566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-67e4fc84-6350-45b9-adb2-d114e5295c00 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:08.295964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-67e4fc84-6350-45b9-adb2-d114e5295c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:08.309669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1070/2130] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:08.314697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3318aaf-f7ef-44d0-8039-f38c8636050c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:08.420106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3318aaf-f7ef-44d0-8039-f38c8636050c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:08.420106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:08.420106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:08.420106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:08.422338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:08.422338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:47:08.422338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:08.422338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:08.422338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1061/2131] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:47:08.427037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4fc84-6350-45b9-adb2-d114e5295c00 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:08.438634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4fc84-6350-45b9-adb2-d114e5295c00 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:08.444873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:08.447029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:08.447815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:08.448383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:08.449757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:08.452374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:08.759636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:08.768866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1071/2132] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:47:08 2022] POST /identity/v3/projects => generated 361 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:47:08.773792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bca0e-dabc-4bfe-b99c-951b6a1a48a5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:08.862593 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:08.863396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:08.864141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:08.864424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:08.865434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:08.867775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:08.966325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1062/2133] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:47:08 2022] POST /identity/v3/users => generated 281 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:47:08.969075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:08.987301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b7a9-bcd4-4a05-9fbb-bb223c27da6c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:08.997346 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:08.998727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:08.998727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:08.998727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.002530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:09.008211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:09.034941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1072/2134] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:09.038992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:09.055157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cc0cd-c086-4704-a42c-44bf640e76e4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:09.065046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbaca1-8c74-4e05-9536-27c88482da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:09.065933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbaca1-8c74-4e05-9536-27c88482da19 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.066219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbaca1-8c74-4e05-9536-27c88482da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.066651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbaca1-8c74-4e05-9536-27c88482da19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.067646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbaca1-8c74-4e05-9536-27c88482da19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:09.069359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbaca1-8c74-4e05-9536-27c88482da19 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:09.085677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1063/2135] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:09.095244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:09.111463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c817-4402-4f8d-9927-42bb00ad8248 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:09.117993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966925ae-e90c-4813-b2f3-8c7c8798ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:09.123802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966925ae-e90c-4813-b2f3-8c7c8798ec83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.124085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966925ae-e90c-4813-b2f3-8c7c8798ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.124361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966925ae-e90c-4813-b2f3-8c7c8798ec83 admin admin] PATH_INFO: `/v3/projects/4fb7f347a19c4866a734122863610f88/users/c009d04f67584714bfdb35f1a223ec82/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.146178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966925ae-e90c-4813-b2f3-8c7c8798ec83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb7f347a19c4866a734122863610f88, user_id=c009d04f67584714bfdb35f1a223ec82, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:09.149767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966925ae-e90c-4813-b2f3-8c7c8798ec83 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:09.218978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.219463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.219552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.221398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1073/2136] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:09 2022] PUT /identity/v3/projects/4fb7f347a19c4866a734122863610f88/users/c009d04f67584714bfdb35f1a223ec82/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:09.231329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.231329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.231329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.263573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] MFA Rules not processed for user `c009d04f67584714bfdb35f1a223ec82`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:09.265273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:09.277852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] MFA Rules not processed for user `e72e8f061290417f8b8a4bb8a0d9d2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:09.279584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:09.338353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1074/2137] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:47:09.366398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1064/2138] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:47:09.370080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:09.375577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:09.377532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:09.379554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:09.435825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482f99d-c51d-48e9-a14a-693a0ba0ae58 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:09.439819 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:09.440450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.440728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.440998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.449220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:09.450645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:09.452936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1e8d1-b115-46ba-97d7-b7d9d0d771a6 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:09.458843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c936b-44ce-4d1a-b30a-7107e6155937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:09.459473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c936b-44ce-4d1a-b30a-7107e6155937 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.459613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1075/2139] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:47:09.459755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c936b-44ce-4d1a-b30a-7107e6155937 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.460029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c936b-44ce-4d1a-b30a-7107e6155937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.468279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c936b-44ce-4d1a-b30a-7107e6155937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:09.470398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c936b-44ce-4d1a-b30a-7107e6155937 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:09.474010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:09.480653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1065/2140] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:47:09.536538 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a07a1-e426-4720-8710-040a920e79fa service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:09.541115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:09.542047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.542390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.542729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] PATH_INFO: `/v3/users/c009d04f67584714bfdb35f1a223ec82` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.544014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c009d04f67584714bfdb35f1a223ec82)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:09.545977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:09.774840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c009d04f67584714bfdb35f1a223ec82'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:09.775491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c009d04f67584714bfdb35f1a223ec82'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:09.787982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c009d04f67584714bfdb35f1a223ec82'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:09.795207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c009d04f67584714bfdb35f1a223ec82'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:09.875168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c009d04f67584714bfdb35f1a223ec82'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:09.882644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1076/2141] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:47:09 2022] DELETE /identity/v3/users/c009d04f67584714bfdb35f1a223ec82 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:47:09.887339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:09.887626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:09.887903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:09.906335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:09.908683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:09.972717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1066/2142] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:09.982918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:09.984116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:10.054299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb25de-d493-43ec-a57a-36f0055f89be admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:10.057936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b85d9-00e6-4941-8df8-8c0a9ee39d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:10.065265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b85d9-00e6-4941-8df8-8c0a9ee39d4e service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:10.065265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b85d9-00e6-4941-8df8-8c0a9ee39d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:10.065265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b85d9-00e6-4941-8df8-8c0a9ee39d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:10.069107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b85d9-00e6-4941-8df8-8c0a9ee39d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:10.070501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b85d9-00e6-4941-8df8-8c0a9ee39d4e service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:10.081011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1077/2143] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:47:10.698587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:10.700430 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:10.721770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa819-40de-47fa-bcca-b6da2598a178 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:10.726377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:10.727249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:10.727527 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:10.727796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] PATH_INFO: `/v3/projects/4fb7f347a19c4866a734122863610f88` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:10.729000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb7f347a19c4866a734122863610f88)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:10.731011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:10.845795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb7f347a19c4866a734122863610f88', 'request_id': 'req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:10.932288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb7f347a19c4866a734122863610f88', 'request_id': 'req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:10.939705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb7f347a19c4866a734122863610f88', 'request_id': 'req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:10.950058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] The token cache is being invalidate because project 4fb7f347a19c4866a734122863610f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:47:10.950354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:10.951012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8dcdb35a-a5f6-4b3c-a26e-97aaf4415439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:47:10.952576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1067/2144] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:47:10 2022] DELETE /identity/v3/projects/4fb7f347a19c4866a734122863610f88 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:47:10.959981 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832d57-b4f1-4b0d-bdf8-4bafa7c3143e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:10.960509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832d57-b4f1-4b0d-bdf8-4bafa7c3143e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:10.960791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832d57-b4f1-4b0d-bdf8-4bafa7c3143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:10.979022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-69832d57-b4f1-4b0d-bdf8-4bafa7c3143e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:10.980274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-69832d57-b4f1-4b0d-bdf8-4bafa7c3143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:11.050158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1078/2145] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:47:11.051663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180abb05-e326-4b42-9707-473a99076241 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.052092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180abb05-e326-4b42-9707-473a99076241 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.052367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180abb05-e326-4b42-9707-473a99076241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.072254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-180abb05-e326-4b42-9707-473a99076241 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:11.073091 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-180abb05-e326-4b42-9707-473a99076241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:11.093048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1068/2146] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:11.100027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69832d57-b4f1-4b0d-bdf8-4bafa7c3143e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:11.112516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69832d57-b4f1-4b0d-bdf8-4bafa7c3143e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:11.122965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:11.123644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.123924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.124199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.124947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:47:11.125250 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:11.127539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:11.150566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180abb05-e326-4b42-9707-473a99076241 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:11.151649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1079/2147] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:47:11.160382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180abb05-e326-4b42-9707-473a99076241 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:11.166687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:11.167664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.168657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.169312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.170679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:11.174518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:11.294036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1069/2148] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:47:11 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:47:11.298815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:11.308920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480ee25-07f5-4832-87cc-8aeccf2b8919 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:11.380699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:11.381384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.381724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.381938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.382666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:11.385561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:11.494118 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1080/2149] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:47:11 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:47:11.498631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:11.521217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8e0cb-87a3-4cca-ab27-a6f3250e9225 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:11.523360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:11.524242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.524733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.525152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.526083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:11.527926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:11.544536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1070/2150] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:11.549526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:11.569867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd34e4-7d13-4324-83a8-edda64939e54 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:11.581456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e81ece-4ebe-472c-baa5-2c9b623399be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:11.582509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e81ece-4ebe-472c-baa5-2c9b623399be admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.583058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e81ece-4ebe-472c-baa5-2c9b623399be admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.583563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e81ece-4ebe-472c-baa5-2c9b623399be admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.585293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e81ece-4ebe-472c-baa5-2c9b623399be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:11.587291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e81ece-4ebe-472c-baa5-2c9b623399be admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:11.608102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1081/2151] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:47:11.608958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:11.619965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d516d-aaa7-4501-b1f8-22c2635cc90d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:11.624591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:11.625469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.625745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.626114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] PATH_INFO: `/v3/projects/258dad22fccd4f84a6ac0ed741a124d9/users/7809e8c1d53e43b1b49ad44afc8bd546/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.646850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258dad22fccd4f84a6ac0ed741a124d9, user_id=7809e8c1d53e43b1b49ad44afc8bd546, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:11.650041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:11.732886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1071/2152] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:47:11 2022] PUT /identity/v3/projects/258dad22fccd4f84a6ac0ed741a124d9/users/7809e8c1d53e43b1b49ad44afc8bd546/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:47:11.744002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4836f1c-1373-4a0d-af06-34c5d5343f39 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.744294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4836f1c-1373-4a0d-af06-34c5d5343f39 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.744570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4836f1c-1373-4a0d-af06-34c5d5343f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.775737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d4836f1c-1373-4a0d-af06-34c5d5343f39 None None] MFA Rules not processed for user `7809e8c1d53e43b1b49ad44afc8bd546`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:11.776962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d4836f1c-1373-4a0d-af06-34c5d5343f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:11.858281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1082/2153] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:11.870473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:47:11.872708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:11.959805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e153ddc-75fe-47af-9efa-12ccdb181608 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:47:11.968187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f16dab-6191-4916-8385-ec13569f2e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:47:11.969449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16dab-6191-4916-8385-ec13569f2e71 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:11.971129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16dab-6191-4916-8385-ec13569f2e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:11.972325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f16dab-6191-4916-8385-ec13569f2e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:11.991485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f16dab-6191-4916-8385-ec13569f2e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:47:12.001952 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f16dab-6191-4916-8385-ec13569f2e71 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:47:12.019972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1072/2154] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:47:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:47:12.458944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4944b-5ebc-413d-b71f-fcd4ccb80c5d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:12.459409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4944b-5ebc-413d-b71f-fcd4ccb80c5d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:12.459495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4944b-5ebc-413d-b71f-fcd4ccb80c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:12.483474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-bca4944b-5ebc-413d-b71f-fcd4ccb80c5d None None] MFA Rules not processed for user `e72e8f061290417f8b8a4bb8a0d9d2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:12.484705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-bca4944b-5ebc-413d-b71f-fcd4ccb80c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:12.547766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1083/2155] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:47:53.974835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5819-3137-4799-b0a6-dc9891a303ef None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:47:53.975438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5819-3137-4799-b0a6-dc9891a303ef None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:47:53.975438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5819-3137-4799-b0a6-dc9891a303ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:47:54.003062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bfda5819-3137-4799-b0a6-dc9891a303ef None None] MFA Rules not processed for user `6a6f7f126c2a4cbe80f029f352c4cafd`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:47:54.004468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bfda5819-3137-4799-b0a6-dc9891a303ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:47:54.075614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1073/2156] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:47:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:00.948293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4944b-5ebc-413d-b71f-fcd4ccb80c5d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:01.056875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4944b-5ebc-413d-b71f-fcd4ccb80c5d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:01.061681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:01.062526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:01.062821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:01.063104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] PATH_INFO: `/v3/users/7809e8c1d53e43b1b49ad44afc8bd546` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:01.064322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7809e8c1d53e43b1b49ad44afc8bd546)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:01.066272 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:01.259138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7809e8c1d53e43b1b49ad44afc8bd546'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:01.259788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7809e8c1d53e43b1b49ad44afc8bd546'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:01.271578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7809e8c1d53e43b1b49ad44afc8bd546'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:01.278165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7809e8c1d53e43b1b49ad44afc8bd546'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:01.364733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7809e8c1d53e43b1b49ad44afc8bd546'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:01.371114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1084/2157] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:48:00 2022] DELETE /identity/v3/users/7809e8c1d53e43b1b49ad44afc8bd546 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:01.375714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:01.376193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:01.376317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:01.419196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:01.420539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:01.477575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1074/2158] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:01.487355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:01.489330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:01.589443 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504d16-2e82-4ad4-a2f6-a8eb3d034171 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:01.592949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:01.593574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:01.593864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:01.594115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:01.603920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:01.605338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:01.614781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1085/2159] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:02.042869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:02.044547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:02.060123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ad9a9-6e8f-470e-bed1-a529bc362f70 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:02.067193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:02.068458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:02.069068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:02.069312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] PATH_INFO: `/v3/projects/258dad22fccd4f84a6ac0ed741a124d9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:02.070543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258dad22fccd4f84a6ac0ed741a124d9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:02.072501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:02.234006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258dad22fccd4f84a6ac0ed741a124d9', 'request_id': 'req-32a6cfb5-3757-403c-8d3c-a8b524705a91'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:02.320256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258dad22fccd4f84a6ac0ed741a124d9', 'request_id': 'req-32a6cfb5-3757-403c-8d3c-a8b524705a91'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:02.327912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258dad22fccd4f84a6ac0ed741a124d9', 'request_id': 'req-32a6cfb5-3757-403c-8d3c-a8b524705a91'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:02.340658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] The token cache is being invalidate because project 258dad22fccd4f84a6ac0ed741a124d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:48:02.341144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:02.346235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-32a6cfb5-3757-403c-8d3c-a8b524705a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:02.346235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1075/2160] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:48:02 2022] DELETE /identity/v3/projects/258dad22fccd4f84a6ac0ed741a124d9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:03.355184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:03.356625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:03.370429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc402e-38ca-46cc-9ff7-fc5384e9ec50 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:03.427500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:03.428362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:03.428641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:03.428911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] PATH_INFO: `/v3/users/971c4fa16e69499a8784f074d09717ee` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:03.430096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971c4fa16e69499a8784f074d09717ee)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:03.432051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:03.602596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971c4fa16e69499a8784f074d09717ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:03.603298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971c4fa16e69499a8784f074d09717ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:03.615779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971c4fa16e69499a8784f074d09717ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:03.622366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971c4fa16e69499a8784f074d09717ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:03.697537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971c4fa16e69499a8784f074d09717ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:03.708116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1086/2161] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:48:03 2022] DELETE /identity/v3/users/971c4fa16e69499a8784f074d09717ee => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:03.712530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:03.712999 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:03.713102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:03.731165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:03.732353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:03.790185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1076/2162] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:03.799775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:03.801898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:03.858055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61fa6-a4b6-4f20-9556-9e654024b1b9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:03.861644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:03.862275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:03.862556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:03.862876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:03.872458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:03.873879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:03.883632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1087/2163] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:04.487780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:04.490121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:04.503273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc7398-6cc1-47f4-80f9-30f4a6e1d964 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:04.508699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:04.509591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:04.509871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:04.510148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] PATH_INFO: `/v3/projects/fa0090f876014fbb8b8682ec4a418abc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:04.511383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0090f876014fbb8b8682ec4a418abc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:04.513301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:04.606247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0090f876014fbb8b8682ec4a418abc', 'request_id': 'req-5fc80a36-1f7f-4231-b185-3a37384e46b9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:04.667270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0090f876014fbb8b8682ec4a418abc', 'request_id': 'req-5fc80a36-1f7f-4231-b185-3a37384e46b9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:04.673677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0090f876014fbb8b8682ec4a418abc', 'request_id': 'req-5fc80a36-1f7f-4231-b185-3a37384e46b9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:04.684441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] The token cache is being invalidate because project fa0090f876014fbb8b8682ec4a418abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:48:04.684655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:04.685271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:04.686784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1077/2164] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:48:04 2022] DELETE /identity/v3/projects/fa0090f876014fbb8b8682ec4a418abc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:06.453880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:06.455354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:06.469603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179afe-0cc0-42b5-a27d-6f95b4b7bd84 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:06.538697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:06.539617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:06.539912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:06.540264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] PATH_INFO: `/v3/users/d22e657c464a42f580afc3e07144e068` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:06.541487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22e657c464a42f580afc3e07144e068)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:06.543459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:06.693195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22e657c464a42f580afc3e07144e068'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:06.693780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22e657c464a42f580afc3e07144e068'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:06.704929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22e657c464a42f580afc3e07144e068'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:06.712220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22e657c464a42f580afc3e07144e068'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:06.794147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22e657c464a42f580afc3e07144e068'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:06.800476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1088/2165] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:48:06 2022] DELETE /identity/v3/users/d22e657c464a42f580afc3e07144e068 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:07.047709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:07.051625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:07.063691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80a36-1f7f-4231-b185-3a37384e46b9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:07.121764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:07.122615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:07.122923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:07.123195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] PATH_INFO: `/v3/projects/15338340751e435eaa8694c88ced6c2d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:07.124408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15338340751e435eaa8694c88ced6c2d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:07.126305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:07.240012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15338340751e435eaa8694c88ced6c2d', 'request_id': 'req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.325908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15338340751e435eaa8694c88ced6c2d', 'request_id': 'req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.332792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15338340751e435eaa8694c88ced6c2d', 'request_id': 'req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.342769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] The token cache is being invalidate because project 15338340751e435eaa8694c88ced6c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:48:07.343076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.343695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.345211 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1078/2166] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:48:07 2022] DELETE /identity/v3/projects/15338340751e435eaa8694c88ced6c2d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:07.349736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:07.351189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:07.364199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe30d-c813-4fd9-b9df-892fadecda35 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:07.420063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:07.420952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:07.421232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:07.421508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] PATH_INFO: `/v3/users/6c8e530c335f404f8d45ba8541be7f5f` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:07.422725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8e530c335f404f8d45ba8541be7f5f)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:07.424708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:07.603077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8e530c335f404f8d45ba8541be7f5f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.603832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8e530c335f404f8d45ba8541be7f5f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.617693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8e530c335f404f8d45ba8541be7f5f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.627806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8e530c335f404f8d45ba8541be7f5f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.691954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-0afb0262-adc4-48e2-b473-71c9ccb68efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8e530c335f404f8d45ba8541be7f5f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:07.698534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1089/2167] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:48:07 2022] DELETE /identity/v3/users/6c8e530c335f404f8d45ba8541be7f5f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:07.943936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:07.945361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:07.957860 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc8e6d-8c7a-4586-a9ff-d77ae09b5c7a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.012874 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.013720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.014051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.014337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] PATH_INFO: `/v3/projects/9d1baec79304448ab95018417941f551` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.015539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1baec79304448ab95018417941f551)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.017448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.119233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1baec79304448ab95018417941f551', 'request_id': 'req-68aa4045-757c-4d0d-8c76-b05a66801663'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:08.169884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1baec79304448ab95018417941f551', 'request_id': 'req-68aa4045-757c-4d0d-8c76-b05a66801663'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:08.176967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1baec79304448ab95018417941f551', 'request_id': 'req-68aa4045-757c-4d0d-8c76-b05a66801663'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:08.187251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] The token cache is being invalidate because project 9d1baec79304448ab95018417941f551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:48:08.187483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:08.188114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-68aa4045-757c-4d0d-8c76-b05a66801663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:08.189636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1079/2168] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:48:07 2022] DELETE /identity/v3/projects/9d1baec79304448ab95018417941f551 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:08.195532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c593-cce9-460a-8f60-5c62c2b26b30 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.195824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c593-cce9-460a-8f60-5c62c2b26b30 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.196124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c593-cce9-460a-8f60-5c62c2b26b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.242475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9167c593-cce9-460a-8f60-5c62c2b26b30 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:08.243687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9167c593-cce9-460a-8f60-5c62c2b26b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:08.299324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1090/2169] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:08.308142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318b2b6-3306-429b-88e0-301e19c78aa4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.308454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318b2b6-3306-429b-88e0-301e19c78aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.308791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318b2b6-3306-429b-88e0-301e19c78aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.327615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9318b2b6-3306-429b-88e0-301e19c78aa4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:08.328806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9318b2b6-3306-429b-88e0-301e19c78aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:08.336617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1080/2170] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:08.340713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c593-cce9-460a-8f60-5c62c2b26b30 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:08.351600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c593-cce9-460a-8f60-5c62c2b26b30 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.356496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.357208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.357491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.357767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.358560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:48:08.359041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.360681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.374859 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1091/2171] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:48:08.379751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318b2b6-3306-429b-88e0-301e19c78aa4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:08.389573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318b2b6-3306-429b-88e0-301e19c78aa4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.394664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.395590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.396037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.396322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.397058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.399054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.483239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1081/2172] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:48:08 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:48:08.485181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:08.496566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceee58-6652-442d-beaf-c8c7244fa9f6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.554872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.555583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.555863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.556134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.556861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.558709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.628301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1092/2173] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:48:08 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:48:08.629257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:08.638737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514d8c-07c2-49fd-add0-7ae501a2a28d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.643334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.643979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.645071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.645496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.646235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.647857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.657846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1082/2174] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:48:08.662653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:08.672963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ef109-c772-4e3e-82a4-eac4c181c95c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.678337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c806533-1c0a-4326-b8d3-da1a96332de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.679033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806533-1c0a-4326-b8d3-da1a96332de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.679313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806533-1c0a-4326-b8d3-da1a96332de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.679584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c806533-1c0a-4326-b8d3-da1a96332de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.680344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806533-1c0a-4326-b8d3-da1a96332de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.682036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c806533-1c0a-4326-b8d3-da1a96332de3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.692172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1093/2175] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:48:08.696177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:08.705928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fedeb-43fe-4ddc-a55a-48345d7bf9df admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.711585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.712541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.712891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.713232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] PATH_INFO: `/v3/projects/6b555b404e554c6db23207d905203a8d/users/754f5815b84e46ada52d9fdd43eb7416/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.729321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b555b404e554c6db23207d905203a8d, user_id=754f5815b84e46ada52d9fdd43eb7416, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.732190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.790040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1083/2176] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:48:08 2022] PUT /identity/v3/projects/6b555b404e554c6db23207d905203a8d/users/754f5815b84e46ada52d9fdd43eb7416/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:48:08.800998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.801318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.801580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.828317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] MFA Rules not processed for user `754f5815b84e46ada52d9fdd43eb7416`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:08.829520 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:08.893974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1094/2177] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:08.904469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:08.906111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:08.960365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d318e1-0bb5-4da1-ae0f-28a7c6b2a10f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:08.963876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235de59-cc96-4832-b180-949e4817dc07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:08.964517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235de59-cc96-4832-b180-949e4817dc07 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:08.964775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235de59-cc96-4832-b180-949e4817dc07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:08.965043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235de59-cc96-4832-b180-949e4817dc07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:08.973163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235de59-cc96-4832-b180-949e4817dc07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:08.974592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235de59-cc96-4832-b180-949e4817dc07 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:08.982961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1084/2178] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:26.374130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:26.375566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:26.438947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78664aa-df5a-48ee-99b4-8273ebf0457c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:26.443454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:26.444306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:26.444580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:26.444847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] PATH_INFO: `/v3/users/1d7540b017f1463cab6d82c67526f197` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:26.446036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7540b017f1463cab6d82c67526f197)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:26.448017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:26.608145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7540b017f1463cab6d82c67526f197'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:26.608718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7540b017f1463cab6d82c67526f197'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:26.621131 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7540b017f1463cab6d82c67526f197'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:26.627865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7540b017f1463cab6d82c67526f197'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:26.679940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7540b017f1463cab6d82c67526f197'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:26.686450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1095/2179] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:48:26 2022] DELETE /identity/v3/users/1d7540b017f1463cab6d82c67526f197 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:26.691106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:26.691583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:26.691699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:26.709131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:26.710576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:26.772497 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1085/2180] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:26.783042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:26.784571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:26.840293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fa7eb-84be-43ed-919d-fd1533b2978c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:26.843926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f86ca-9bd6-4337-8f12-a2c5ae37d3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:26.844560 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f86ca-9bd6-4337-8f12-a2c5ae37d3ad service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:26.844837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f86ca-9bd6-4337-8f12-a2c5ae37d3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:26.845109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f86ca-9bd6-4337-8f12-a2c5ae37d3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:26.854888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f86ca-9bd6-4337-8f12-a2c5ae37d3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:26.856307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f86ca-9bd6-4337-8f12-a2c5ae37d3ad service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:26.865848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1096/2181] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:27.234490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:27.236124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:27.248738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028d3bc-e14a-4912-a51f-c4875526bc65 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:27.254312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:27.256788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.256788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.256788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] PATH_INFO: `/v3/projects/312aa3bc689a4238bb1aac1160776469` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.258388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312aa3bc689a4238bb1aac1160776469)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:27.260467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:27.394582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312aa3bc689a4238bb1aac1160776469', 'request_id': 'req-8658088f-298a-4051-8dcf-45dcfc0539e2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:27.468276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312aa3bc689a4238bb1aac1160776469', 'request_id': 'req-8658088f-298a-4051-8dcf-45dcfc0539e2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:27.475032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312aa3bc689a4238bb1aac1160776469', 'request_id': 'req-8658088f-298a-4051-8dcf-45dcfc0539e2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:27.485390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] The token cache is being invalidate because project 312aa3bc689a4238bb1aac1160776469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:48:27.485681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:27.486352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8658088f-298a-4051-8dcf-45dcfc0539e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:27.488152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1086/2182] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:48:27 2022] DELETE /identity/v3/projects/312aa3bc689a4238bb1aac1160776469 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:48:27.493791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86825b2-b414-4ba0-a7d7-7daf65e767e7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.494278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86825b2-b414-4ba0-a7d7-7daf65e767e7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.494368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86825b2-b414-4ba0-a7d7-7daf65e767e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.513709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d86825b2-b414-4ba0-a7d7-7daf65e767e7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:27.514924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d86825b2-b414-4ba0-a7d7-7daf65e767e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:27.575055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1097/2183] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:27.582667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40f1ee-e265-4061-9a4f-2bea612b8c29 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.582995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40f1ee-e265-4061-9a4f-2bea612b8c29 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.583275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40f1ee-e265-4061-9a4f-2bea612b8c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.601788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7d40f1ee-e265-4061-9a4f-2bea612b8c29 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:27.603024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7d40f1ee-e265-4061-9a4f-2bea612b8c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:27.611001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1087/2184] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:27.616159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86825b2-b414-4ba0-a7d7-7daf65e767e7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:27.625578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86825b2-b414-4ba0-a7d7-7daf65e767e7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:27.630420 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:27.631705 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.631984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.632274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.632982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:48:27.633282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:27.634892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:27.646070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1098/2185] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:48:27.650199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40f1ee-e265-4061-9a4f-2bea612b8c29 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:27.659165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40f1ee-e265-4061-9a4f-2bea612b8c29 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:27.663876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:27.664503 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.664784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.665054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.665758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:27.667670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:27.738585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1088/2186] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:48:27 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:48:27.743776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:27.754080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626417e-c918-4445-8353-fa78448cf453 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:27.812305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:27.812967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.813245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.813613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.814319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:27.816285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:27.916832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1099/2187] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:48:27 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:48:27.918530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:27.929040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d1f2e-8694-4f93-8565-92ec6f30eaf8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:27.934143 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:27.934926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.935213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.935481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.936315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:27.938024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:27.949217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1089/2188] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:48:27.953245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:27.964178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932dc12-a1f6-44f8-a225-f3a7f42ed919 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:27.969012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5881f4-4aeb-4a73-b358-e523eee8043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:27.969672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5881f4-4aeb-4a73-b358-e523eee8043b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:27.969948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5881f4-4aeb-4a73-b358-e523eee8043b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:27.970243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5881f4-4aeb-4a73-b358-e523eee8043b admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:27.971028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5881f4-4aeb-4a73-b358-e523eee8043b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:27.972668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5881f4-4aeb-4a73-b358-e523eee8043b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:27.982779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1100/2189] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:48:27.986849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:27.996540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a5793-574e-4f49-b160-74fc843e7455 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:28.001103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:28.001956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:28.002234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:28.002507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] PATH_INFO: `/v3/projects/da4c790370b0480987d6f683e631f625/users/cf861981989d4bafa0fb10a39c58a14f/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:28.017865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4c790370b0480987d6f683e631f625, user_id=cf861981989d4bafa0fb10a39c58a14f, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:28.020554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:28.092781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1090/2190] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:48:27 2022] PUT /identity/v3/projects/da4c790370b0480987d6f683e631f625/users/cf861981989d4bafa0fb10a39c58a14f/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:48:28.103102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc83cb-a4bf-4107-8620-605d6971aa21 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:28.103394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc83cb-a4bf-4107-8620-605d6971aa21 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:28.103671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc83cb-a4bf-4107-8620-605d6971aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:28.129399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-8bdc83cb-a4bf-4107-8620-605d6971aa21 None None] MFA Rules not processed for user `cf861981989d4bafa0fb10a39c58a14f`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:28.131125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8bdc83cb-a4bf-4107-8620-605d6971aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:28.197412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1101/2191] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:28.207358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:28.209733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:28.287318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b4e9b-f5a1-48a5-9d94-c1c1920d8c4c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:28.291299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:28.291971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:28.292249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:28.292520 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:28.301768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:28.303963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:28.312951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1091/2192] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:39.205516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a48d8-3448-4054-89c5-627273d89356 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:39.206022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a48d8-3448-4054-89c5-627273d89356 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:39.206109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a48d8-3448-4054-89c5-627273d89356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:39.223902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-872a48d8-3448-4054-89c5-627273d89356 None None] MFA Rules not processed for user `6a6f7f126c2a4cbe80f029f352c4cafd`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:39.226025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-872a48d8-3448-4054-89c5-627273d89356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:39.281359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1102/2193] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:41.060723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:41.062183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:41.152277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69b728-6125-4664-aab0-e0d87a24675e service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:41.157202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a7097-4737-4683-9ec2-6d5a05e205bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:41.157828 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a7097-4737-4683-9ec2-6d5a05e205bb service placement] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:41.158102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a7097-4737-4683-9ec2-6d5a05e205bb service placement] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:41.158371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a7097-4737-4683-9ec2-6d5a05e205bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:41.160179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-209a7097-4737-4683-9ec2-6d5a05e205bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:41.171905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a7097-4737-4683-9ec2-6d5a05e205bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:41.173458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a7097-4737-4683-9ec2-6d5a05e205bb service placement] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:41.183661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1092/2194] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:41.922727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a48d8-3448-4054-89c5-627273d89356 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:41.924612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-872a48d8-3448-4054-89c5-627273d89356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:41.997562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a48d8-3448-4054-89c5-627273d89356 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:42.002196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:42.003566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:42.003865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:42.004137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] PATH_INFO: `/v3/users/754f5815b84e46ada52d9fdd43eb7416` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:42.005520 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754f5815b84e46ada52d9fdd43eb7416)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:42.007964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:42.168551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754f5815b84e46ada52d9fdd43eb7416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:42.169208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754f5815b84e46ada52d9fdd43eb7416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:42.182218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754f5815b84e46ada52d9fdd43eb7416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:42.188828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754f5815b84e46ada52d9fdd43eb7416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:42.239809 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754f5815b84e46ada52d9fdd43eb7416'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:42.246965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1103/2195] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:48:41 2022] DELETE /identity/v3/users/754f5815b84e46ada52d9fdd43eb7416 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:48:42.251628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:42.252141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:42.252234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:42.271356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:42.273199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:42.341054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1093/2196] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:42.351975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:42.353392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:42.409715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eab19-6a82-48da-9895-f759575e1431 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:42.416781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ab31-8933-4866-ac03-e017ace50bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:42.417424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ab31-8933-4866-ac03-e017ace50bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:42.417706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ab31-8933-4866-ac03-e017ace50bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:42.417984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ab31-8933-4866-ac03-e017ace50bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:42.428171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ab31-8933-4866-ac03-e017ace50bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:42.430447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ab31-8933-4866-ac03-e017ace50bb3 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:42.441979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1104/2197] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:48:43.001013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:43.002476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:43.025354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fee77-7e1c-451f-b24d-ea91646767ff None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:43.030348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:43.031522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.032041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.032441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] PATH_INFO: `/v3/projects/6b555b404e554c6db23207d905203a8d` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.033806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b555b404e554c6db23207d905203a8d)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:43.035872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:43.126602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b555b404e554c6db23207d905203a8d', 'request_id': 'req-9525608b-8792-4eeb-ad50-e4bab19eddda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:43.229903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b555b404e554c6db23207d905203a8d', 'request_id': 'req-9525608b-8792-4eeb-ad50-e4bab19eddda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:43.237302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b555b404e554c6db23207d905203a8d', 'request_id': 'req-9525608b-8792-4eeb-ad50-e4bab19eddda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:43.253667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] The token cache is being invalidate because project 6b555b404e554c6db23207d905203a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:48:43.254658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:43.255633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9525608b-8792-4eeb-ad50-e4bab19eddda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:48:43.257896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1094/2198] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:48:42 2022] DELETE /identity/v3/projects/6b555b404e554c6db23207d905203a8d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:43.263453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7bbf0-d7f7-4f38-bb26-4d068abaabc1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.263904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7bbf0-d7f7-4f38-bb26-4d068abaabc1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.264011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7bbf0-d7f7-4f38-bb26-4d068abaabc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.283519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7fe7bbf0-d7f7-4f38-bb26-4d068abaabc1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:43.284832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7fe7bbf0-d7f7-4f38-bb26-4d068abaabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:43.343739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1105/2199] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:43.352764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004486b-84ca-49eb-b066-dd3471f70085 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.353054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004486b-84ca-49eb-b066-dd3471f70085 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.353332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004486b-84ca-49eb-b066-dd3471f70085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.372441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2004486b-84ca-49eb-b066-dd3471f70085 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:43.372717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2004486b-84ca-49eb-b066-dd3471f70085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:43.380767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1095/2200] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:43.390094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7bbf0-d7f7-4f38-bb26-4d068abaabc1 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:43.400617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7bbf0-d7f7-4f38-bb26-4d068abaabc1 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:43.405444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:43.406086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.406367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.406642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.407462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:48:43.415378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:43.415378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:43.421740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1106/2201] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:48:43.426045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004486b-84ca-49eb-b066-dd3471f70085 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:43.435427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004486b-84ca-49eb-b066-dd3471f70085 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:43.440099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:43.440732 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.441012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.441284 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.442036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:43.447148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:43.510238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1096/2202] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:48:43 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:48:43.514433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:43.524273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604cbcf-890c-46ba-83d7-525e294dd002 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:43.581076 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:43.581735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.582017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.582292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.583079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:43.585074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:43.695854 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1107/2203] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:48:43 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:48:43.700042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:43.710136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c975f-c28a-47ad-8d73-9a335bc0a7b4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:43.714811 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:43.715533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.715816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.716088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.716826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:43.718462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:43.729254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1097/2204] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:48:43.733075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:43.743672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5636983-2cef-4d47-b9d6-770a86cb2d93 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:43.748409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f16d2b-ddb4-4e57-8f31-b17eacbf4ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:43.749083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16d2b-ddb4-4e57-8f31-b17eacbf4ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.752919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16d2b-ddb4-4e57-8f31-b17eacbf4ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.752919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f16d2b-ddb4-4e57-8f31-b17eacbf4ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.752919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f16d2b-ddb4-4e57-8f31-b17eacbf4ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:43.752919 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f16d2b-ddb4-4e57-8f31-b17eacbf4ea1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:43.762043 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1108/2205] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:48:43.765913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:43.776027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db71ed-63a7-4129-b405-83fd31f6ff56 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:43.781077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:43.781947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.782266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.782547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] PATH_INFO: `/v3/projects/30fced24126f40ac94f018df7c960a15/users/e7557280caf846d6bdd96d80e1d28333/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.797912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fced24126f40ac94f018df7c960a15, user_id=e7557280caf846d6bdd96d80e1d28333, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:43.800717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:43.931934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1098/2206] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:48:43 2022] PUT /identity/v3/projects/30fced24126f40ac94f018df7c960a15/users/e7557280caf846d6bdd96d80e1d28333/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:48:43.937148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06e5ef-f859-4882-a4af-bd5698daf6cb None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:43.937436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06e5ef-f859-4882-a4af-bd5698daf6cb None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:43.937800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06e5ef-f859-4882-a4af-bd5698daf6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:43.956144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3a06e5ef-f859-4882-a4af-bd5698daf6cb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:43.957434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3a06e5ef-f859-4882-a4af-bd5698daf6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:44.013730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1109/2207] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:44.024123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:44.025805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:44.080858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45406feb-b35d-4c36-a69c-801449e8241e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:44.084496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:44.085758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:44.085888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:44.086162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:44.095421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:44.096845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:44.106615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1099/2208] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:45.245141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0bb1-927a-487f-8151-3414f6f4d35d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:45.245694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0bb1-927a-487f-8151-3414f6f4d35d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:45.245910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0bb1-927a-487f-8151-3414f6f4d35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:45.288320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-0c1d0bb1-927a-487f-8151-3414f6f4d35d None None] MFA Rules not processed for user `e7557280caf846d6bdd96d80e1d28333`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:45.289923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0c1d0bb1-927a-487f-8151-3414f6f4d35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:45.361729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1110/2209] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:48:45.372241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:48:45.373764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:45.439333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ce43-b974-456b-b050-f4997d22f327 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:48:45.445670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb8e2b-3d7e-4781-a089-bcc27472bd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:48:45.446554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb8e2b-3d7e-4781-a089-bcc27472bd2d service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:45.446862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb8e2b-3d7e-4781-a089-bcc27472bd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:45.447655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb8e2b-3d7e-4781-a089-bcc27472bd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:45.457589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb8e2b-3d7e-4781-a089-bcc27472bd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:48:45.459041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb8e2b-3d7e-4781-a089-bcc27472bd2d service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:48:45.470388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1100/2210] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:48:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:48:48.199647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:48:48.200159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:48:48.200258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:48:48.218879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] MFA Rules not processed for user `e7557280caf846d6bdd96d80e1d28333`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:48:48.220072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:48:48.227916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1111/2211] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:48:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:13.935218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261c4c4-9184-48e6-be68-d13ead4e35cd None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:13.935737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261c4c4-9184-48e6-be68-d13ead4e35cd None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:13.935833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261c4c4-9184-48e6-be68-d13ead4e35cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:13.953758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f261c4c4-9184-48e6-be68-d13ead4e35cd None None] MFA Rules not processed for user `e7557280caf846d6bdd96d80e1d28333`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:13.955215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f261c4c4-9184-48e6-be68-d13ead4e35cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:13.963447 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1101/2212] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:24.749282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:24.750999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:24.767292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8afec4-207b-4f97-95e2-fb45a97b2b17 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:24.772210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:24.773068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:24.773348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:24.773623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] PATH_INFO: `/v3/users/25740a911eb440c2a81d4dbcbba95c99` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:24.775279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25740a911eb440c2a81d4dbcbba95c99)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:24.777209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:24.974307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25740a911eb440c2a81d4dbcbba95c99'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:24.975031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25740a911eb440c2a81d4dbcbba95c99'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:24.988187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25740a911eb440c2a81d4dbcbba95c99'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:24.996662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25740a911eb440c2a81d4dbcbba95c99'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:25.067632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-79d885ca-efc3-4f17-a671-6d47e0ca6288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25740a911eb440c2a81d4dbcbba95c99'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:25.074054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1112/2213] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:24 2022] DELETE /identity/v3/users/25740a911eb440c2a81d4dbcbba95c99 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:25.332796 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261c4c4-9184-48e6-be68-d13ead4e35cd None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:25.345719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261c4c4-9184-48e6-be68-d13ead4e35cd None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:25.418749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:25.419664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:25.420324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:25.420324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] PATH_INFO: `/v3/projects/a785b6652097442291512fdd26f966ee` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:25.421456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a785b6652097442291512fdd26f966ee)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:25.423422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:25.519454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a785b6652097442291512fdd26f966ee', 'request_id': 'req-19c9e756-ec97-408a-b69e-2f473b2004f1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:25.570349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a785b6652097442291512fdd26f966ee', 'request_id': 'req-19c9e756-ec97-408a-b69e-2f473b2004f1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:25.577257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a785b6652097442291512fdd26f966ee', 'request_id': 'req-19c9e756-ec97-408a-b69e-2f473b2004f1'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:25.587832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] The token cache is being invalidate because project a785b6652097442291512fdd26f966ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:25.588120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:25.588743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-19c9e756-ec97-408a-b69e-2f473b2004f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:25.590270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1102/2214] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:25 2022] DELETE /identity/v3/projects/a785b6652097442291512fdd26f966ee => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:25.596230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335154c7-ed6d-410b-8fbe-fcf6b91de58b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:25.596512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335154c7-ed6d-410b-8fbe-fcf6b91de58b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:25.596787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335154c7-ed6d-410b-8fbe-fcf6b91de58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:25.614539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-335154c7-ed6d-410b-8fbe-fcf6b91de58b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:25.615764 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-335154c7-ed6d-410b-8fbe-fcf6b91de58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:25.673961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1113/2215] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:25.682398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5389c26-3b69-46b4-91e6-4d83db7ec528 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:25.682710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5389c26-3b69-46b4-91e6-4d83db7ec528 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:25.683039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5389c26-3b69-46b4-91e6-4d83db7ec528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:25.702286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e5389c26-3b69-46b4-91e6-4d83db7ec528 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:25.703552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e5389c26-3b69-46b4-91e6-4d83db7ec528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:25.712202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1103/2216] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:25.716788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335154c7-ed6d-410b-8fbe-fcf6b91de58b None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:25.726595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335154c7-ed6d-410b-8fbe-fcf6b91de58b None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:25.731933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:25.732613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:25.732894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:25.733198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:25.733937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:49:25.734239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:25.735907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:25.748362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1114/2217] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:49:25.752882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5389c26-3b69-46b4-91e6-4d83db7ec528 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:25.763424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5389c26-3b69-46b4-91e6-4d83db7ec528 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:25.768155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:25.768804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:25.769087 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:25.769362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:25.770097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:25.772041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:25.858360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1104/2218] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:25 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:25.862331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:25.872765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16bf3-dc43-4b34-84b0-e9751b96df82 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:25.927983 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:25.928662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:25.928939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:25.929209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:25.929911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:25.931979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.011064 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1115/2219] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:25 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:26.013496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.025524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9ee88-2699-432c-8dfc-7f8df48e7ad7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.030548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.031287 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.031623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.031835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.032563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.034129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.045167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1105/2220] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:26.049171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.059585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eb07a-c5b5-4e0f-9895-f0f7d36c03f0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.064478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d402a-4f53-4859-ac08-a802cc77565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.065129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d402a-4f53-4859-ac08-a802cc77565a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.065407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d402a-4f53-4859-ac08-a802cc77565a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.065674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d402a-4f53-4859-ac08-a802cc77565a admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.066403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d402a-4f53-4859-ac08-a802cc77565a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.068016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d402a-4f53-4859-ac08-a802cc77565a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.077842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1116/2221] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:26.081974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.092828 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8ad4b-9a76-45fd-a0fd-f40ad578510a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.097457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.098324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.098604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.098910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] PATH_INFO: `/v3/projects/8e7ec6df4a574204a84b25f1152e4758/users/10f74f996dde4031b015f76425ccd7c3/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.114204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7ec6df4a574204a84b25f1152e4758, user_id=10f74f996dde4031b015f76425ccd7c3, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.116862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.199562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1106/2222] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:26 2022] PUT /identity/v3/projects/8e7ec6df4a574204a84b25f1152e4758/users/10f74f996dde4031b015f76425ccd7c3/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:26.209400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e78ad-6bf0-4fe3-b3ab-0ba22a3f1638 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.209689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e78ad-6bf0-4fe3-b3ab-0ba22a3f1638 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.209963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e78ad-6bf0-4fe3-b3ab-0ba22a3f1638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.238277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-640e78ad-6bf0-4fe3-b3ab-0ba22a3f1638 None None] MFA Rules not processed for user `10f74f996dde4031b015f76425ccd7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:26.239522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-640e78ad-6bf0-4fe3-b3ab-0ba22a3f1638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:26.305159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1117/2223] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:26.309802 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.369177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082359d-ea41-41f1-b062-bc14baf69472 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.374079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.374854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.375089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.375364 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.376066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.378221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.452647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1107/2224] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:26 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:26.457018 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e78ad-6bf0-4fe3-b3ab-0ba22a3f1638 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.468879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e78ad-6bf0-4fe3-b3ab-0ba22a3f1638 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.523621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.524927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.525206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.525477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.526194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.528144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.635049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1118/2225] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:26 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:26.638930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.649564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7708fd-a23d-409b-9563-fc8d2c97402b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.654250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.654975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.655243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.655518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.656250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.657829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.668137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1108/2226] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:26.672168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.683099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337455d-81c7-4c93-bfc4-db021773ca6f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.687818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.692446 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.692446 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.692446 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] PATH_INFO: `/v3/projects/f48f63380ebb4919b70538aa07786f62/users/eaf8e6ef8dac438db99781253a53de55/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.704180 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48f63380ebb4919b70538aa07786f62, user_id=eaf8e6ef8dac438db99781253a53de55, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.706915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.760047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1119/2227] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:26 2022] PUT /identity/v3/projects/f48f63380ebb4919b70538aa07786f62/users/eaf8e6ef8dac438db99781253a53de55/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:26.763926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.774246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93550-8bb3-48c4-9f68-4167d985a08a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.830441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf1772-8152-4968-b16b-72caac63e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.831162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf1772-8152-4968-b16b-72caac63e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.831461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf1772-8152-4968-b16b-72caac63e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.831774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf1772-8152-4968-b16b-72caac63e2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.832631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf1772-8152-4968-b16b-72caac63e2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.834320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf1772-8152-4968-b16b-72caac63e2f3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.844478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1109/2228] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:26.848742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:26.859597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eabec-81bb-47c5-abb0-f98cbc4d778c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:26.864340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:26.865365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.865649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.865924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] PATH_INFO: `/v3/projects/f48f63380ebb4919b70538aa07786f62/users/eaf8e6ef8dac438db99781253a53de55/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.868447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48f63380ebb4919b70538aa07786f62, user_id=eaf8e6ef8dac438db99781253a53de55, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:26.871306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:26.882021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1120/2229] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:26 2022] PUT /identity/v3/projects/f48f63380ebb4919b70538aa07786f62/users/eaf8e6ef8dac438db99781253a53de55/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:26.893984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:26.899074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:26.899074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:26.921907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] MFA Rules not processed for user `eaf8e6ef8dac438db99781253a53de55`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:26.923248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:26.996720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1110/2230] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:27.006766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:27.009135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:27.066313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5090e-5958-4865-9694-f3a9faed4bef admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:27.069850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:27.070487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:27.070834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:27.071115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:27.080909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:27.082360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:27.092685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1121/2231] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:27.360464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:27.362343 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:27.375016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea7a9d-7ff6-4e5e-8e52-cd6d148c94e1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:27.378876 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e97fb-13ed-49db-9611-6607bacd29d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:27.379511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e97fb-13ed-49db-9611-6607bacd29d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:27.379789 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e97fb-13ed-49db-9611-6607bacd29d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:27.380223 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e97fb-13ed-49db-9611-6607bacd29d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:27.440679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e97fb-13ed-49db-9611-6607bacd29d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:27.442628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e97fb-13ed-49db-9611-6607bacd29d3 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:27.456052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1111/2232] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:28.710566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:28.712509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:28.775996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2890-b4a4-4e04-886a-dc2a4788f8d8 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:28.780808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:28.781733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:28.781956 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:28.782228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] PATH_INFO: `/v3/users/cf861981989d4bafa0fb10a39c58a14f` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:28.783502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf861981989d4bafa0fb10a39c58a14f)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:28.785477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:28.981243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf861981989d4bafa0fb10a39c58a14f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:28.981907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf861981989d4bafa0fb10a39c58a14f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:28.993975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf861981989d4bafa0fb10a39c58a14f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.001534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf861981989d4bafa0fb10a39c58a14f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.078969 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf861981989d4bafa0fb10a39c58a14f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.085669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1122/2233] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:28 2022] DELETE /identity/v3/users/cf861981989d4bafa0fb10a39c58a14f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:29.091020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:29.091460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:29.091694 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:29.110145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:29.111508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:29.170321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1112/2234] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:29.182013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:29.183585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:29.241849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bd7e-9306-47e7-a236-ce695eb9e55c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:29.246469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdda3b-c454-46f4-8853-1661cccaa7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:29.247122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdda3b-c454-46f4-8853-1661cccaa7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:29.247402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdda3b-c454-46f4-8853-1661cccaa7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:29.247671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdda3b-c454-46f4-8853-1661cccaa7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:29.263889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdda3b-c454-46f4-8853-1661cccaa7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:29.265355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdda3b-c454-46f4-8853-1661cccaa7d3 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:29.276902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1123/2235] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:29.723189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:29.724705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:29.738245 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f1c5e-f16e-4916-8dcf-0853531604ed None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:29.745252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:29.749187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:29.749187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:29.749187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] PATH_INFO: `/v3/projects/da4c790370b0480987d6f683e631f625` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:29.749187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4c790370b0480987d6f683e631f625)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:29.750296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:29.866937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4c790370b0480987d6f683e631f625', 'request_id': 'req-55d0885d-9bff-491f-803c-4ae54e81deef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.947508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4c790370b0480987d6f683e631f625', 'request_id': 'req-55d0885d-9bff-491f-803c-4ae54e81deef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.954317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4c790370b0480987d6f683e631f625', 'request_id': 'req-55d0885d-9bff-491f-803c-4ae54e81deef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.964411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] The token cache is being invalidate because project da4c790370b0480987d6f683e631f625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:29.964702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.965326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-55d0885d-9bff-491f-803c-4ae54e81deef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:29.966872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1113/2236] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:29 2022] DELETE /identity/v3/projects/da4c790370b0480987d6f683e631f625 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:29.972474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb93d96-e752-4d6e-9112-139ceefefda8 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:29.972955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb93d96-e752-4d6e-9112-139ceefefda8 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:29.973062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb93d96-e752-4d6e-9112-139ceefefda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:29.990483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-feb93d96-e752-4d6e-9112-139ceefefda8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:29.991802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-feb93d96-e752-4d6e-9112-139ceefefda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:30.057201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1124/2237] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:30.065061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384588cf-c009-40cb-a86d-d8cb2af9e915 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.065423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384588cf-c009-40cb-a86d-d8cb2af9e915 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.065792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384588cf-c009-40cb-a86d-d8cb2af9e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.084707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-384588cf-c009-40cb-a86d-d8cb2af9e915 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:30.085911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-384588cf-c009-40cb-a86d-d8cb2af9e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:30.093969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1114/2238] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:30.099540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb93d96-e752-4d6e-9112-139ceefefda8 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:30.110262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb93d96-e752-4d6e-9112-139ceefefda8 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:30.115068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:30.115742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.116021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.116293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.117110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:49:30.117435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:30.119303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:30.131278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1125/2239] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:49:30.136378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384588cf-c009-40cb-a86d-d8cb2af9e915 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:30.145377 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384588cf-c009-40cb-a86d-d8cb2af9e915 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:30.150076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:30.150713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.151030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.151303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.152054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:30.153944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:30.253387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1115/2240] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:30 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:30.257587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:30.267448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca956692-cafc-4871-b6a6-a1f33e9b25de admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:30.323249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:30.323905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.324179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.324450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.325150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:30.327077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:30.431703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1126/2241] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:30 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:30.438758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:30.449672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696dbd5-4594-4f61-ab7b-17da217fff2c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:30.454471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:30.455370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.455656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.455933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.456710 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:30.458330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:30.474049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1116/2242] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:30.475417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:30.486930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136f95d-0be4-489b-8c22-89171f18287f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:30.491631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be8b9c-2328-4e25-93e0-3638a0264dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:30.492289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8b9c-2328-4e25-93e0-3638a0264dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.492610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8b9c-2328-4e25-93e0-3638a0264dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.492885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8b9c-2328-4e25-93e0-3638a0264dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.493625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be8b9c-2328-4e25-93e0-3638a0264dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:30.495426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be8b9c-2328-4e25-93e0-3638a0264dbb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:30.510243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1127/2243] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:30.511396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:30.521892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5c39-7498-4da9-b9f4-9e39cf432b0f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:30.528806 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:30.529553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.529834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.530126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] PATH_INFO: `/v3/projects/32bc488217794302b16e40a559bec3c8/users/67b2e5f365144062bd2612f5d3ebd077/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.545536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bc488217794302b16e40a559bec3c8, user_id=67b2e5f365144062bd2612f5d3ebd077, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:30.548269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:30.634301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1117/2244] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:30 2022] PUT /identity/v3/projects/32bc488217794302b16e40a559bec3c8/users/67b2e5f365144062bd2612f5d3ebd077/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:30.639485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.639777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.640057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.657338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:30.658522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:30.714613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1128/2245] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:30.724162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:30.725814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:30.780990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a25b07-3c6b-4a67-8f85-b8b25cc5dfff admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:30.784672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22425846-4222-40db-b890-f6e198261cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:30.785301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22425846-4222-40db-b890-f6e198261cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:30.785628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22425846-4222-40db-b890-f6e198261cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:30.785883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22425846-4222-40db-b890-f6e198261cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:30.798773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22425846-4222-40db-b890-f6e198261cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:30.801356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22425846-4222-40db-b890-f6e198261cf9 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:30.813108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1118/2246] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:31.112160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:31.119792 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:31.126566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de3a18-ebe9-4137-89ea-19eafbdcfecb None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:31.131751 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:31.132600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:31.132872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:31.133187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] PATH_INFO: `/v3/users/10f74f996dde4031b015f76425ccd7c3` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:31.134548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f74f996dde4031b015f76425ccd7c3)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:31.138590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:31.344113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f74f996dde4031b015f76425ccd7c3'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:31.344807 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f74f996dde4031b015f76425ccd7c3'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:31.358383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f74f996dde4031b015f76425ccd7c3'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:31.371040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f74f996dde4031b015f76425ccd7c3'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:31.450211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f74f996dde4031b015f76425ccd7c3'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:31.456783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1129/2247] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:31 2022] DELETE /identity/v3/users/10f74f996dde4031b015f76425ccd7c3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:31.462148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c54db-84dd-4462-8292-e13d497f0099 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:31.463107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c54db-84dd-4462-8292-e13d497f0099 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:31.463397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c54db-84dd-4462-8292-e13d497f0099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:31.482391 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-899c54db-84dd-4462-8292-e13d497f0099 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:31.483759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-899c54db-84dd-4462-8292-e13d497f0099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:31.565469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1119/2248] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:31.577407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:31.578878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:31.647597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8886c-5d0b-4ae2-a776-e7b221dc0cef admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:31.655547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:31.655547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:31.655547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:31.655547 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:31.666076 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:31.667734 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:31.684406 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1130/2249] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:32.147075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:32.147296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:32.147576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:32.172548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:32.174060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:32.190139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] MFA Rules not processed for user `67b2e5f365144062bd2612f5d3ebd077`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:32.192469 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:32.194726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646e2eb-29f0-4a90-97e5-68983f3ecbde service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:32.205079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:32.206525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:32.206831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:32.207114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] PATH_INFO: `/v3/projects/8e7ec6df4a574204a84b25f1152e4758` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:32.208380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7ec6df4a574204a84b25f1152e4758)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:32.215989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:32.266097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1120/2250] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:32.276138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:32.277465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:32.333321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614f04-7663-4762-859f-eeada4dffac9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:32.337393 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:32.338021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:32.338298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:32.338558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:32.347100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:32.348574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:32.350258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7ec6df4a574204a84b25f1152e4758', 'request_id': 'req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.356957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7ec6df4a574204a84b25f1152e4758', 'request_id': 'req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.358704 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1121/2251] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:49:32.427910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7ec6df4a574204a84b25f1152e4758', 'request_id': 'req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.440372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] The token cache is being invalidate because project 8e7ec6df4a574204a84b25f1152e4758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:32.440848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.441472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.443045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1131/2252] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:32 2022] DELETE /identity/v3/projects/8e7ec6df4a574204a84b25f1152e4758 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:32.447926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:32.458545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1b341-cc3b-44e4-bf28-cd248460dd12 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:32.515557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:32.516416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:32.516706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:32.516960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] PATH_INFO: `/v3/users/eaf8e6ef8dac438db99781253a53de55` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:32.518173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf8e6ef8dac438db99781253a53de55)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:32.521515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:32.721967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf8e6ef8dac438db99781253a53de55'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.801583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf8e6ef8dac438db99781253a53de55'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.806913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf8e6ef8dac438db99781253a53de55'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.807620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf8e6ef8dac438db99781253a53de55'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.815660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0cb3fc1b-fbe1-47ce-ba76-6123fb22285a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf8e6ef8dac438db99781253a53de55'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:32.834602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1122/2253] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:32 2022] DELETE /identity/v3/users/eaf8e6ef8dac438db99781253a53de55 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:33.454192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:33.454192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:33.473976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0fc76-a3be-41ef-9d97-ae3ea3b34652 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:33.535213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:33.536058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:33.536330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:33.536596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] PATH_INFO: `/v3/projects/f48f63380ebb4919b70538aa07786f62` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:33.537769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48f63380ebb4919b70538aa07786f62)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:33.539812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:33.661537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48f63380ebb4919b70538aa07786f62', 'request_id': 'req-124e3db8-602d-4b46-97de-30c4ef6f1773'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:33.667614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48f63380ebb4919b70538aa07786f62', 'request_id': 'req-124e3db8-602d-4b46-97de-30c4ef6f1773'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:33.730477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48f63380ebb4919b70538aa07786f62', 'request_id': 'req-124e3db8-602d-4b46-97de-30c4ef6f1773'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:33.741738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] The token cache is being invalidate because project f48f63380ebb4919b70538aa07786f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:33.742022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:33.743294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-124e3db8-602d-4b46-97de-30c4ef6f1773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:33.745038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1132/2254] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:33 2022] DELETE /identity/v3/projects/f48f63380ebb4919b70538aa07786f62 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:33.752653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cad56-692e-41ca-b4c2-ea45ec05c3f8 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:33.753139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cad56-692e-41ca-b4c2-ea45ec05c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:33.753232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cad56-692e-41ca-b4c2-ea45ec05c3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:33.772896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-386cad56-692e-41ca-b4c2-ea45ec05c3f8 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:33.774157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-386cad56-692e-41ca-b4c2-ea45ec05c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:33.832161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1123/2255] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:33.839992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146593-c64c-4446-a866-da37bf623118 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:33.840275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146593-c64c-4446-a866-da37bf623118 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:33.840552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146593-c64c-4446-a866-da37bf623118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:33.859725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-44146593-c64c-4446-a866-da37bf623118 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:33.861096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-44146593-c64c-4446-a866-da37bf623118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:33.869858 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1133/2256] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:33.873784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cad56-692e-41ca-b4c2-ea45ec05c3f8 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:33.883511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cad56-692e-41ca-b4c2-ea45ec05c3f8 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:33.888002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:33.888650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:33.888928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:33.889196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:33.890121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:49:33.890427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:33.892070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:33.903482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1124/2257] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:49:33.907713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44146593-c64c-4446-a866-da37bf623118 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:33.918062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44146593-c64c-4446-a866-da37bf623118 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:33.922693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:33.923373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:33.923676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:33.923945 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:33.924661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:33.926595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.008674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1134/2258] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:33 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:34.012915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:34.036510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e047a46-a7c9-4903-92f7-2aee1ecb0a32 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:34.142666 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:34.143444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.143728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.144003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.144726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:34.146853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.283033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1125/2259] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:34 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:49:34.287702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:34.309115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ccd67-9c7a-44e3-bff8-07548da5a58e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:34.314501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:34.315345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.315727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.316105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.316996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:34.318948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.330604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1135/2260] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:34.337293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:34.349487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e12a8d-6775-42e0-a479-66024f966ca1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:34.356000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a607b-101a-4c98-b921-a009cf203a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:34.357029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a607b-101a-4c98-b921-a009cf203a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.360448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a607b-101a-4c98-b921-a009cf203a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.360448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a607b-101a-4c98-b921-a009cf203a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.360448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a607b-101a-4c98-b921-a009cf203a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:34.360448 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a607b-101a-4c98-b921-a009cf203a88 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.386476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1126/2261] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:34.392407 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:34.404820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960781a3-51ce-4a4c-80e1-ae92d7359896 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:34.410213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:34.411181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.411548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.412004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] PATH_INFO: `/v3/projects/f37ec08b627945548e6c38795cb2a739/users/752e3d3aa6194665a2b2c8a9ee011cd0/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.428681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37ec08b627945548e6c38795cb2a739, user_id=752e3d3aa6194665a2b2c8a9ee011cd0, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:34.432054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.498833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1136/2262] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:34 2022] PUT /identity/v3/projects/f37ec08b627945548e6c38795cb2a739/users/752e3d3aa6194665a2b2c8a9ee011cd0/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:34.509234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc31c-94fe-43fc-ad07-6b3dbb81c286 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.509544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc31c-94fe-43fc-ad07-6b3dbb81c286 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.509832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cc31c-94fe-43fc-ad07-6b3dbb81c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.542403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0a6cc31c-94fe-43fc-ad07-6b3dbb81c286 None None] MFA Rules not processed for user `752e3d3aa6194665a2b2c8a9ee011cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:34.543715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0a6cc31c-94fe-43fc-ad07-6b3dbb81c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:34.613975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1127/2263] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:34.618569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:34.686096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f4997-046c-4415-8bcf-5ed838cd59c7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:34.691189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:34.691889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.692172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.692447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.693161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:34.695236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.800908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1137/2264] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:34 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:49:34.804948 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc31c-94fe-43fc-ad07-6b3dbb81c286 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:34.816325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cc31c-94fe-43fc-ad07-6b3dbb81c286 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:34.873148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:34.873805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.874093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.874346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.875092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:34.877002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.959850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1128/2265] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:34 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:34.963535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:34.974430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f699a-b10c-4382-93f0-8cf6b3490b04 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:34.979319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:34.979970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:34.980292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:34.980570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:34.981305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:34.982921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:34.996479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1138/2266] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:34.997778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.009204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7a5d2-0671-4ca1-91e9-343fac204e7f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.013992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f327e4-b9f6-42ea-99c8-591cb4a8f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.014684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f327e4-b9f6-42ea-99c8-591cb4a8f91a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.015008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f327e4-b9f6-42ea-99c8-591cb4a8f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.015285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f327e4-b9f6-42ea-99c8-591cb4a8f91a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.016024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f327e4-b9f6-42ea-99c8-591cb4a8f91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.017662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f327e4-b9f6-42ea-99c8-591cb4a8f91a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.027851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1129/2267] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:35.031982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.042529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944be54-e9b9-4b51-9567-40f43f1363b4 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.047302 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70f3c6-292d-4445-bf40-d3b1b1b5d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.048179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f3c6-292d-4445-bf40-d3b1b1b5d750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.048463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f3c6-292d-4445-bf40-d3b1b1b5d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.048739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f3c6-292d-4445-bf40-d3b1b1b5d750 admin admin] PATH_INFO: `/v3/projects/0c9b4e83b0ff464f8cd125e48cf65111/users/78fa38ef1b7649569dfda4949bdec7d4/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.064738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70f3c6-292d-4445-bf40-d3b1b1b5d750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9b4e83b0ff464f8cd125e48cf65111, user_id=78fa38ef1b7649569dfda4949bdec7d4, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.067441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70f3c6-292d-4445-bf40-d3b1b1b5d750 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.156053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1139/2268] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:35 2022] PUT /identity/v3/projects/0c9b4e83b0ff464f8cd125e48cf65111/users/78fa38ef1b7649569dfda4949bdec7d4/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:35.172539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd6627-97a6-4054-83c5-b8a9d3040f58 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.172833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd6627-97a6-4054-83c5-b8a9d3040f58 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.173106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd6627-97a6-4054-83c5-b8a9d3040f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.182165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466a93-15ef-4e1a-97e4-d2e9721631c6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.182600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466a93-15ef-4e1a-97e4-d2e9721631c6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.183006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466a93-15ef-4e1a-97e4-d2e9721631c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.204217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9afd6627-97a6-4054-83c5-b8a9d3040f58 None None] MFA Rules not processed for user `78fa38ef1b7649569dfda4949bdec7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:35.205814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9afd6627-97a6-4054-83c5-b8a9d3040f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:35.220807 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-da466a93-15ef-4e1a-97e4-d2e9721631c6 None None] MFA Rules not processed for user `67b2e5f365144062bd2612f5d3ebd077`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:35.222017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-da466a93-15ef-4e1a-97e4-d2e9721631c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:35.272208 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1130/2269] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:35.276754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd6627-97a6-4054-83c5-b8a9d3040f58 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.278845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1140/2270] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:35.353479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd6627-97a6-4054-83c5-b8a9d3040f58 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.356142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.356829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.357106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.357392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.358210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.360155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.482049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1131/2271] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:35 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:49:35.486027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466a93-15ef-4e1a-97e4-d2e9721631c6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.499710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466a93-15ef-4e1a-97e4-d2e9721631c6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.560211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.560885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.561164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.561435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.562195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.564892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.651373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1141/2272] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:35 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:35.655398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.666157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b92d-d079-4987-8530-cc1e36d7f09f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.671027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.671760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.672051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.677718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.677718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.677718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.685869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1132/2273] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:49:35.690147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.700381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78e738-abca-47f3-8321-39b59fb68de8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.705031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.705933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.706387 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.706666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] PATH_INFO: `/v3/projects/4456e0395de740159556d28b57401660/users/f8b8f481dfbe460b997e73171782daa1/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.722445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4456e0395de740159556d28b57401660, user_id=f8b8f481dfbe460b997e73171782daa1, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.725258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.794860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1142/2274] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:35 2022] PUT /identity/v3/projects/4456e0395de740159556d28b57401660/users/f8b8f481dfbe460b997e73171782daa1/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:35.799060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.809190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebfff4-69c4-404f-9fdc-c33332d40fbd admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.865684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6148d3-995b-471f-b1b6-df8f90e4828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.866353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6148d3-995b-471f-b1b6-df8f90e4828b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.866641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6148d3-995b-471f-b1b6-df8f90e4828b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.866950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6148d3-995b-471f-b1b6-df8f90e4828b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.867735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6148d3-995b-471f-b1b6-df8f90e4828b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.869414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6148d3-995b-471f-b1b6-df8f90e4828b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.879322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1133/2275] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:35.883673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:35.894520 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36b44-161e-49b8-bfd1-8a5dbd2b5a58 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:35.899908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:35.900773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.901052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.901322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] PATH_INFO: `/v3/projects/4456e0395de740159556d28b57401660/users/f8b8f481dfbe460b997e73171782daa1/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.903358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4456e0395de740159556d28b57401660, user_id=f8b8f481dfbe460b997e73171782daa1, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:35.906043 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:35.917533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1143/2276] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:35 2022] PUT /identity/v3/projects/4456e0395de740159556d28b57401660/users/f8b8f481dfbe460b997e73171782daa1/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:35.927696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9eb2e-4461-40f4-b39d-eaa82ae95067 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:35.928061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9eb2e-4461-40f4-b39d-eaa82ae95067 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:35.928406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9eb2e-4461-40f4-b39d-eaa82ae95067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:35.963123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-7bf9eb2e-4461-40f4-b39d-eaa82ae95067 None None] MFA Rules not processed for user `f8b8f481dfbe460b997e73171782daa1`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:35.964323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7bf9eb2e-4461-40f4-b39d-eaa82ae95067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:36.042166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1134/2277] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:36.052408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:36.054345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:36.116321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa8eb-4007-40e5-9b3e-7ccbcd595ad3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:36.120132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265bce-bd5e-4cf7-9348-10d3ca20337d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:36.120793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265bce-bd5e-4cf7-9348-10d3ca20337d service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:36.121237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265bce-bd5e-4cf7-9348-10d3ca20337d service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:36.121519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265bce-bd5e-4cf7-9348-10d3ca20337d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:36.130935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265bce-bd5e-4cf7-9348-10d3ca20337d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:36.132528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265bce-bd5e-4cf7-9348-10d3ca20337d service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:36.143013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1144/2278] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:37.153325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9eb2e-4461-40f4-b39d-eaa82ae95067 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:37.166478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9eb2e-4461-40f4-b39d-eaa82ae95067 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:37.176467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:37.176467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:37.176467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:37.176467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:37.234411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:37.235997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:37.246388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1135/2279] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:49:43.801548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:43.805004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:43.805004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:43.877115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:43.879673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:43.959343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1145/2280] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:49:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:44.010617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:44.012348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:44.103633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6219-7a8d-4337-ba18-fd6669803e99 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:44.108654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:44.119458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:44.119458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:44.119458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:44.119458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:44.119759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:44.128334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1136/2281] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:49:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:47.449989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:47.451672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:47.558089 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e937-3644-44b4-8761-41bf8ad265b5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:47.563138 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:47.565207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:47.565207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:47.565207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] PATH_INFO: `/v3/users/6a6f7f126c2a4cbe80f029f352c4cafd` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:47.566576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6f7f126c2a4cbe80f029f352c4cafd)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:47.568783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:47.731892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6f7f126c2a4cbe80f029f352c4cafd'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:47.734132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6f7f126c2a4cbe80f029f352c4cafd'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:47.755864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6f7f126c2a4cbe80f029f352c4cafd'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:47.757913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6f7f126c2a4cbe80f029f352c4cafd'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:47.832885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2346b7b1-1328-46c5-8b98-5b4ce1ef15ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6f7f126c2a4cbe80f029f352c4cafd'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:47.839605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1146/2282] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:47 2022] DELETE /identity/v3/users/6a6f7f126c2a4cbe80f029f352c4cafd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:48.144551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:48.166248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185620-aaf3-4d28-8881-e8867671997a service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:48.288845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:48.294824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:48.294824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:48.294824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] PATH_INFO: `/v3/projects/41828fbc91c740cfbec65e04e92a4ecc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:48.294824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41828fbc91c740cfbec65e04e92a4ecc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:48.294824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:48.476491 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41828fbc91c740cfbec65e04e92a4ecc', 'request_id': 'req-e50e56e6-9f1a-4755-b898-c6ea23862b1a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:48.553604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41828fbc91c740cfbec65e04e92a4ecc', 'request_id': 'req-e50e56e6-9f1a-4755-b898-c6ea23862b1a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:48.560973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41828fbc91c740cfbec65e04e92a4ecc', 'request_id': 'req-e50e56e6-9f1a-4755-b898-c6ea23862b1a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:48.572613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] The token cache is being invalidate because project 41828fbc91c740cfbec65e04e92a4ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:48.572910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:48.573657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e50e56e6-9f1a-4755-b898-c6ea23862b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:48.575560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1137/2283] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:48 2022] DELETE /identity/v3/projects/41828fbc91c740cfbec65e04e92a4ecc => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:48.583426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:48.584108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:48.584108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:48.604704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:48.605914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:48.685955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1147/2284] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:48.688828 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4f50-b572-484e-8490-3dfa3aa27ed4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:48.689120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4f50-b572-484e-8490-3dfa3aa27ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:48.689398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4f50-b572-484e-8490-3dfa3aa27ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:48.696893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:48.698402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:48.712613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-165a4f50-b572-484e-8490-3dfa3aa27ed4 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:48.714302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-165a4f50-b572-484e-8490-3dfa3aa27ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:48.723518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1138/2285] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:48.727531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a4f50-b572-484e-8490-3dfa3aa27ed4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:48.738501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a4f50-b572-484e-8490-3dfa3aa27ed4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:48.744438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471483-aff6-4032-be25-146361b53917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:48.745585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471483-aff6-4032-be25-146361b53917 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:48.745891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471483-aff6-4032-be25-146361b53917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:48.746173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471483-aff6-4032-be25-146361b53917 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:48.746966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471483-aff6-4032-be25-146361b53917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:49:48.747275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471483-aff6-4032-be25-146361b53917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:48.749446 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471483-aff6-4032-be25-146361b53917 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:48.766845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1139/2286] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:49:48.771208 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471483-aff6-4032-be25-146361b53917 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:48.794844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471483-aff6-4032-be25-146361b53917 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:48.799784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6d3ca-0a57-4484-a72b-e3335183fc7e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:48.802685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:48.803715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:48.804132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:48.804463 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:48.804679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:48.804805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:48.805008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:48.805197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:48.806642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:48.809216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:48.809450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:48.882327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:48.884641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:48.894683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1148/2287] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:49:48.949810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1140/2288] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:48 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:48.954275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:48.966975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ded85-1f92-4942-a982-58d3fa406271 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:49.059497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:49.060123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:49.060405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:49.060674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:49.061391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:49.063352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:49.132918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1149/2289] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:48 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:49.137541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:49.151402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4dd6-a322-495e-964b-8e2318756415 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:49.158884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:49.159984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:49.160533 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:49.161094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:49.162153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:49.164585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:49.178128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1141/2290] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:49.182680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:49.194061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b065b9f-6e4c-4ece-9896-7b595d6bcbe9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:49.201786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ad65f-376e-4ae5-81ed-65a95949aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:49.202466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad65f-376e-4ae5-81ed-65a95949aeae admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:49.202750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad65f-376e-4ae5-81ed-65a95949aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:49.203071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad65f-376e-4ae5-81ed-65a95949aeae admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:49.204061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ad65f-376e-4ae5-81ed-65a95949aeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:49.205789 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ad65f-376e-4ae5-81ed-65a95949aeae admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:49.217610 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1150/2291] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:49.221789 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:49.233459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb84f8-a797-480a-b6cc-ef9722c64f10 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:49.239422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:49.240711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:49.241059 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:49.241578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] PATH_INFO: `/v3/projects/75ab61cc17cd440aa9f5c20637f63164/users/811582f011e940f59bc03d62ce58d46d/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:49.260736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ab61cc17cd440aa9f5c20637f63164, user_id=811582f011e940f59bc03d62ce58d46d, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:49.265028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:49.402037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1142/2292] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:49 2022] PUT /identity/v3/projects/75ab61cc17cd440aa9f5c20637f63164/users/811582f011e940f59bc03d62ce58d46d/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:49.412178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c5ab3-48c0-405b-a564-b368152dfd7b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:49.412679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c5ab3-48c0-405b-a564-b368152dfd7b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:49.412951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c5ab3-48c0-405b-a564-b368152dfd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:49.442826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3e9c5ab3-48c0-405b-a564-b368152dfd7b None None] MFA Rules not processed for user `811582f011e940f59bc03d62ce58d46d`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:49.444259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3e9c5ab3-48c0-405b-a564-b368152dfd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:49.551806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1151/2293] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:49.562986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:49.564781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:49.694140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3817-efd4-421e-8518-7f5c1c069c95 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:49.700737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53264ab6-01e7-4c8b-a7dc-5a1609bca1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:49.701593 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264ab6-01e7-4c8b-a7dc-5a1609bca1a4 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:49.701878 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264ab6-01e7-4c8b-a7dc-5a1609bca1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:49.702156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53264ab6-01e7-4c8b-a7dc-5a1609bca1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:49.710671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264ab6-01e7-4c8b-a7dc-5a1609bca1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:49.712371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53264ab6-01e7-4c8b-a7dc-5a1609bca1a4 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:49.723436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1143/2294] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:53.214625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c5ab3-48c0-405b-a564-b368152dfd7b None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:53.291957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c5ab3-48c0-405b-a564-b368152dfd7b None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:53.297108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:53.303866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:53.303866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:53.303866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] PATH_INFO: `/v3/users/811582f011e940f59bc03d62ce58d46d` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:53.303866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=811582f011e940f59bc03d62ce58d46d)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:53.303866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:53.756591 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811582f011e940f59bc03d62ce58d46d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:53.758003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811582f011e940f59bc03d62ce58d46d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:53.773051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811582f011e940f59bc03d62ce58d46d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:53.781822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811582f011e940f59bc03d62ce58d46d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:53.867241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811582f011e940f59bc03d62ce58d46d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:53.873982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1152/2295] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:53 2022] DELETE /identity/v3/users/811582f011e940f59bc03d62ce58d46d => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:53.878641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:53.879201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:53.879304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:53.901228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:53.901228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:53.994749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1144/2296] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:54.001833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:54.004233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:54.074899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f568a-a8dc-47ed-be7a-6bfd2b5a9063 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:54.084556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:54.085231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:54.085492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:54.085776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:54.120805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:54.122298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:54.133939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1153/2297] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:54.592653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:54.597149 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:54.615431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a6ad4-3f47-444c-812c-9b627f9b8926 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:54.643477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:54.648748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:54.648748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:54.648748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] PATH_INFO: `/v3/users/752e3d3aa6194665a2b2c8a9ee011cd0` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:54.657786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=752e3d3aa6194665a2b2c8a9ee011cd0)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:54.659792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:54.681329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:54.683060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:54.700427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199a8a9-4575-4d62-839b-1fa880fdbdbd service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:54.709025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:54.710270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:54.710549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:54.710851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] PATH_INFO: `/v3/projects/75ab61cc17cd440aa9f5c20637f63164` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:54.712241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ab61cc17cd440aa9f5c20637f63164)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:54.714174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:54.959729 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752e3d3aa6194665a2b2c8a9ee011cd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:54.967665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ab61cc17cd440aa9f5c20637f63164', 'request_id': 'req-50819d74-430f-42f5-acf7-953c1667aad5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:54.981147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ab61cc17cd440aa9f5c20637f63164', 'request_id': 'req-50819d74-430f-42f5-acf7-953c1667aad5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.102653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752e3d3aa6194665a2b2c8a9ee011cd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.103457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752e3d3aa6194665a2b2c8a9ee011cd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.104252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752e3d3aa6194665a2b2c8a9ee011cd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.114868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-23f8cf20-f8ad-43a6-a634-20ce35ea02aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752e3d3aa6194665a2b2c8a9ee011cd0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.143467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1145/2298] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:54 2022] DELETE /identity/v3/users/752e3d3aa6194665a2b2c8a9ee011cd0 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:55.159647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ab61cc17cd440aa9f5c20637f63164', 'request_id': 'req-50819d74-430f-42f5-acf7-953c1667aad5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.160270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.161170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.162131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.179737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] The token cache is being invalidate because project 75ab61cc17cd440aa9f5c20637f63164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:55.180218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.181344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-50819d74-430f-42f5-acf7-953c1667aad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:55.183308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1154/2299] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:54 2022] DELETE /identity/v3/projects/75ab61cc17cd440aa9f5c20637f63164 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:55.191695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4565-a2d1-4dcd-8719-1446f6544f27 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.192046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4565-a2d1-4dcd-8719-1446f6544f27 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.192379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:55.193218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4565-a2d1-4dcd-8719-1446f6544f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.194011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:55.239603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a59f4565-a2d1-4dcd-8719-1446f6544f27 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:55.241342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a59f4565-a2d1-4dcd-8719-1446f6544f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:55.327933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1146/2300] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:55.342632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1155/2301] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:55.342872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:55.342872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:55.347228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083264-f0cd-49b3-bab0-edfa9f1fe70f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.350908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083264-f0cd-49b3-bab0-edfa9f1fe70f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.350908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083264-f0cd-49b3-bab0-edfa9f1fe70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.393684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-fe083264-f0cd-49b3-bab0-edfa9f1fe70f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:55.396885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fe083264-f0cd-49b3-bab0-edfa9f1fe70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:55.415414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1156/2302] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:55.417207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083264-f0cd-49b3-bab0-edfa9f1fe70f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:55.436872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083264-f0cd-49b3-bab0-edfa9f1fe70f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:55.449319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:55.452611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.452611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.452611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.452611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:49:55.452611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:55.478048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:55.494644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1157/2303] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:49:55.503447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:55.514899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4171-e1fb-4313-9c39-20c8e2bef05b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:55.515045 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefa216-e1de-4468-a7f2-c6173b08c3bb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:55.522064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:55.523369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:55.524257 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.524622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.525126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.525241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.525522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.525956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.526293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:55.528376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:55.564685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:55.567728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:55.585381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1147/2304] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:49:55.629486 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1158/2305] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:55 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:55.634429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:55.651976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a219e-b7e8-4044-a0fa-23f2dd077cc6 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:55.775079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:55.775772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.776133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.776294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.777019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:55.781265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:55.906492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1148/2306] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:55 2022] POST /identity/v3/users => generated 282 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:55.907423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:55.921635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48602-3813-43d2-bb22-56b717c5ebe3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:55.928695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:55.930820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.931423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.931902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.934519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:55.937773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:55.950628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1159/2307] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:55.957062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:55.975380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdca1b-68b7-4273-9922-094ef6a7146e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:55.982296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212f31c-1056-4282-96ec-d38a36808772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:55.983920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212f31c-1056-4282-96ec-d38a36808772 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:55.984494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212f31c-1056-4282-96ec-d38a36808772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:55.984975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212f31c-1056-4282-96ec-d38a36808772 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:55.986070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212f31c-1056-4282-96ec-d38a36808772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:55.989873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212f31c-1056-4282-96ec-d38a36808772 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:56.010812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1149/2308] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:56.013928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:56.025031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b493cf-41bb-49fd-877f-d265cae70b35 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:56.033992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:56.035617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.036097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.037061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] PATH_INFO: `/v3/projects/175a7b077cc544198e2320c796b32724/users/6482df56e0054138925e03a31c902256/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:56.069597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175a7b077cc544198e2320c796b32724, user_id=6482df56e0054138925e03a31c902256, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:56.074781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:56.171581 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1160/2309] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:56 2022] PUT /identity/v3/projects/175a7b077cc544198e2320c796b32724/users/6482df56e0054138925e03a31c902256/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:56.171958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49740d-3829-4db8-b5d4-87a6a0ebbc8c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.172254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49740d-3829-4db8-b5d4-87a6a0ebbc8c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.172532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49740d-3829-4db8-b5d4-87a6a0ebbc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:56.204097 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fc49740d-3829-4db8-b5d4-87a6a0ebbc8c None None] MFA Rules not processed for user `6482df56e0054138925e03a31c902256`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:56.205596 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fc49740d-3829-4db8-b5d4-87a6a0ebbc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:56.260145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:56.268551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:56.317285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1150/2310] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:56.318359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49740d-3829-4db8-b5d4-87a6a0ebbc8c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:56.390472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056079fd-df4e-41c7-b435-b2fa322d5908 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:56.396600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:56.397713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.398015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.398356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] PATH_INFO: `/v3/projects/f37ec08b627945548e6c38795cb2a739` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:56.400411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37ec08b627945548e6c38795cb2a739)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:56.402385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:56.418753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49740d-3829-4db8-b5d4-87a6a0ebbc8c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:56.426699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f55033-784b-41ba-8f5c-1ed30ce749b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:56.428038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55033-784b-41ba-8f5c-1ed30ce749b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.432001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55033-784b-41ba-8f5c-1ed30ce749b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.432001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f55033-784b-41ba-8f5c-1ed30ce749b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:56.432001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55033-784b-41ba-8f5c-1ed30ce749b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:56.432001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f55033-784b-41ba-8f5c-1ed30ce749b2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:56.577970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37ec08b627945548e6c38795cb2a739', 'request_id': 'req-e5418753-c094-4ca8-87dd-303e55dad263'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:56.585129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37ec08b627945548e6c38795cb2a739', 'request_id': 'req-e5418753-c094-4ca8-87dd-303e55dad263'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:56.595543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1151/2311] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:49:56 2022] POST /identity/v3/projects => generated 363 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:56.595543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.595543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.595543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:56.616961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:56.619883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:56.661852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37ec08b627945548e6c38795cb2a739', 'request_id': 'req-e5418753-c094-4ca8-87dd-303e55dad263'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:56.690039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] The token cache is being invalidate because project f37ec08b627945548e6c38795cb2a739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:56.690508 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:56.691532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:56.696873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1161/2312] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:56 2022] DELETE /identity/v3/projects/f37ec08b627945548e6c38795cb2a739 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:56.698027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:56.701801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:56.716053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1152/2313] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:49:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:49:56.717428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:56.719029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:56.815274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5418753-c094-4ca8-87dd-303e55dad263 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:56.821651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:56.822554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.823347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.823777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:56.824742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:56.827274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:56.828483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58233e4e-a89d-4ce8-bba2-3f6245ac8638 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:56.841370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:56.843184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.843619 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.844128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] PATH_INFO: `/v3/users/78fa38ef1b7649569dfda4949bdec7d4` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:56.845615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] RBAC: Authorizing `identity:delete_user(user_id=78fa38ef1b7649569dfda4949bdec7d4)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:56.849248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:56.903122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1162/2314] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:49:56 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:49:56.904215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:56.906145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:56.992679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c561ba-cd59-4278-af8b-900bbbac63e3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:56.998367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:56.999052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:56.999360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:56.999612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:57.017667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:57.019449 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:57.034500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1163/2315] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:49:57.035880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:57.047669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6b615-a84e-432d-a7bb-9230b893f581 service swift] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:57.055891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:57.057094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:57.057773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:57.058342 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:57.059991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:57.063355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:57.077917 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78fa38ef1b7649569dfda4949bdec7d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:57.101132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1164/2316] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:57.101132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:57.141198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f020b7a-18c9-4a79-a5bc-32b1deba0712 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:57.143803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:57.144746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:57.145033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:57.145306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] PATH_INFO: `/v3/projects/6ed66573118a4c8199b0dadc75bea461/users/a7b1dd16c0024e28a7ce1316453bf9c3/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:57.159111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78fa38ef1b7649569dfda4949bdec7d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:57.160067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78fa38ef1b7649569dfda4949bdec7d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:57.161063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78fa38ef1b7649569dfda4949bdec7d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:57.171893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78fa38ef1b7649569dfda4949bdec7d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:57.176174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed66573118a4c8199b0dadc75bea461, user_id=a7b1dd16c0024e28a7ce1316453bf9c3, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:57.176174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:57.201099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1153/2317] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:56 2022] DELETE /identity/v3/users/78fa38ef1b7649569dfda4949bdec7d4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:57.353698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1165/2318] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:57 2022] PUT /identity/v3/projects/6ed66573118a4c8199b0dadc75bea461/users/a7b1dd16c0024e28a7ce1316453bf9c3/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:57.357649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:57.359057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:57.554053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6ae36-b74f-4a9c-8d32-395bf75f912b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:57.718461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d6781-4c44-4584-8ee1-176d13c7010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:57.719192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6781-4c44-4584-8ee1-176d13c7010c admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:57.719482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6781-4c44-4584-8ee1-176d13c7010c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:57.719765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6781-4c44-4584-8ee1-176d13c7010c admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:57.720519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d6781-4c44-4584-8ee1-176d13c7010c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:57.723873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d6781-4c44-4584-8ee1-176d13c7010c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:57.744634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1154/2319] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:49:57.745868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:57.765608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4467bc-dea8-4bbb-81c1-5f91bf8cdf5d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:57.770529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:57.771607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:57.772055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:57.772505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] PATH_INFO: `/v3/projects/6ed66573118a4c8199b0dadc75bea461/users/a7b1dd16c0024e28a7ce1316453bf9c3/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:57.779954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed66573118a4c8199b0dadc75bea461, user_id=a7b1dd16c0024e28a7ce1316453bf9c3, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:57.782911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:57.825145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1166/2320] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:49:57 2022] PUT /identity/v3/projects/6ed66573118a4c8199b0dadc75bea461/users/a7b1dd16c0024e28a7ce1316453bf9c3/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:57.835416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:57.835884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:57.837403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:57.888560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] MFA Rules not processed for user `a7b1dd16c0024e28a7ce1316453bf9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:57.890394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:57.913536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:57.918923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:58.135951 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27102f6-ea88-41cb-8aba-4c7bd1aa134d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:58.141950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1155/2321] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:58.154989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:58.159224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:58.160261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:58.161421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:58.162450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:58.164623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] PATH_INFO: `/v3/projects/0c9b4e83b0ff464f8cd125e48cf65111` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:58.166524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9b4e83b0ff464f8cd125e48cf65111)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:58.168844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:58.329522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36f1b-39e1-47d5-bb6b-da3252d739c4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:58.351781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9b4e83b0ff464f8cd125e48cf65111', 'request_id': 'req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:58.374759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9b4e83b0ff464f8cd125e48cf65111', 'request_id': 'req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:58.426347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:58.426997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:58.427283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:58.427557 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:58.462055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9b4e83b0ff464f8cd125e48cf65111', 'request_id': 'req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:58.489005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] The token cache is being invalidate because project 0c9b4e83b0ff464f8cd125e48cf65111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:49:58.489317 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:58.494763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:58.497638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1167/2322] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:49:57 2022] DELETE /identity/v3/projects/0c9b4e83b0ff464f8cd125e48cf65111 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:49:58.506033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:58.521624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:58.628169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:58.633369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:58.659580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1156/2323] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:49:58.767478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa1d74-bea7-4aa8-9e87-a95d9ef84bb9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:58.789251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:58.790374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:58.790667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:58.790973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] PATH_INFO: `/v3/users/f8b8f481dfbe460b997e73171782daa1` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:58.792306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b8f481dfbe460b997e73171782daa1)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:58.796897 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:59.090827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b8f481dfbe460b997e73171782daa1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.092047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b8f481dfbe460b997e73171782daa1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.124055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b8f481dfbe460b997e73171782daa1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.124281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:59.138631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b8f481dfbe460b997e73171782daa1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.142398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e1e9a-b254-4a3a-a0eb-c63afc6cee29 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:49:59.159603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:49:59.160501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:59.160774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:59.161051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] PATH_INFO: `/v3/users/6482df56e0054138925e03a31c902256` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:59.162369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6482df56e0054138925e03a31c902256)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:49:59.164322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:49:59.198739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7332ff00-a78a-410d-bed3-fc78368bb1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b8f481dfbe460b997e73171782daa1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.206057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1168/2324] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:58 2022] DELETE /identity/v3/users/f8b8f481dfbe460b997e73171782daa1 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:59.413696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6482df56e0054138925e03a31c902256'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.507419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6482df56e0054138925e03a31c902256'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.508652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6482df56e0054138925e03a31c902256'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.509595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6482df56e0054138925e03a31c902256'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.522074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6482df56e0054138925e03a31c902256'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:49:59.601864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:49:59.606773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:49:59.606924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1157/2325] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:49:59 2022] DELETE /identity/v3/users/6482df56e0054138925e03a31c902256 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:49:59.607425 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:49:59.667991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:49:59.669251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:49:59.955375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1169/2326] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:49:59.960167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:49:59.979807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:00.134434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef43d0a-2b77-4804-abb8-a90a834af639 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:00.140177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158da408-3dc3-4581-a377-103ee2a9e5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:00.142340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da408-3dc3-4581-a377-103ee2a9e5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:00.142951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da408-3dc3-4581-a377-103ee2a9e5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:00.145075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da408-3dc3-4581-a377-103ee2a9e5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:00.166120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158da408-3dc3-4581-a377-103ee2a9e5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:00.167702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158da408-3dc3-4581-a377-103ee2a9e5a1 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:00.184106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1158/2327] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:00.238749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:00.243124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:00.283566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d688dad-5f99-4359-b1ca-14f4e59b3b47 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:00.306952 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:00.308344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:00.309000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:00.309489 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] PATH_INFO: `/v3/projects/4456e0395de740159556d28b57401660` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:00.311462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4456e0395de740159556d28b57401660)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:00.317658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:00.531540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4456e0395de740159556d28b57401660', 'request_id': 'req-377fbd2f-e1f1-4b85-bf82-36a6614dda03'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:00.543234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4456e0395de740159556d28b57401660', 'request_id': 'req-377fbd2f-e1f1-4b85-bf82-36a6614dda03'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:00.616491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4456e0395de740159556d28b57401660', 'request_id': 'req-377fbd2f-e1f1-4b85-bf82-36a6614dda03'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:00.637728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] The token cache is being invalidate because project 4456e0395de740159556d28b57401660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:00.638025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:00.638990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-377fbd2f-e1f1-4b85-bf82-36a6614dda03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:00.645165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1170/2328] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:00 2022] DELETE /identity/v3/projects/4456e0395de740159556d28b57401660 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:00.655472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:00.655803 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:00.656085 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:00.698852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:00.700099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:00.833272 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225cef-6d21-4676-80bd-835ca288493e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:00.834018 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225cef-6d21-4676-80bd-835ca288493e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:00.834467 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225cef-6d21-4676-80bd-835ca288493e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:00.839438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1159/2329] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:00.859030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:00.860663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:00.886481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df95e-1e0c-4813-8a5a-f644ad4b3a80 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:00.897816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c8225cef-6d21-4676-80bd-835ca288493e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:00.900934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c8225cef-6d21-4676-80bd-835ca288493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:00.904574 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:00.916052 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:00.916355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:00.916642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] PATH_INFO: `/v3/projects/175a7b077cc544198e2320c796b32724` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:00.927642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=175a7b077cc544198e2320c796b32724)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:00.929617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:00.967837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1171/2330] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:00.978703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225cef-6d21-4676-80bd-835ca288493e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:01.001153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225cef-6d21-4676-80bd-835ca288493e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:01.021288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:01.021990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:01.022323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:01.022683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:01.023326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:01.024737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:01.026362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:01.071640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1172/2331] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:01.073568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:01.106058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd833e9c-0ae5-4d2f-9d1a-cb23939b2f89 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:01.127964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175a7b077cc544198e2320c796b32724', 'request_id': 'req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.213248 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:01.213556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:01.213809 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:01.214497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:01.216133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:01.216800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:01.222179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175a7b077cc544198e2320c796b32724', 'request_id': 'req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.231518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175a7b077cc544198e2320c796b32724', 'request_id': 'req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.269365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] The token cache is being invalidate because project 175a7b077cc544198e2320c796b32724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:01.269938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.272138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.276572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1160/2332] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:00 2022] DELETE /identity/v3/projects/175a7b077cc544198e2320c796b32724 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:01.280398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:01.284650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:01.331862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d199e-65cb-41f1-9f4d-a0b35849eb69 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:01.344237 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:01.345176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:01.345965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:01.346082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] PATH_INFO: `/v3/users/a7b1dd16c0024e28a7ce1316453bf9c3` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:01.348075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b1dd16c0024e28a7ce1316453bf9c3)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:01.350255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:01.381698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1173/2333] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:01 2022] POST /identity/v3/projects => generated 393 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:01.413271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:01.413271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:01.505827 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196d96-3ff5-4eea-b762-d715d92c4248 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:01.521303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:01.522115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:01.522461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:01.522922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:01.524453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:01.526716 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:01.856501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1174/2334] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:01 2022] POST /identity/v3/users => generated 297 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:01.860607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:01.870390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f76a22-522e-43dc-899a-4275008fab16 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:01.875175 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:01.875817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:01.876097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:01.876207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b1dd16c0024e28a7ce1316453bf9c3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.876368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:01.877435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:01.879095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:01.889652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1175/2335] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:01.893590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:01.903932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e41a3-29f0-41e1-b829-b923218d9797 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:01.909270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:01.909929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:01.910198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:01.911006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:01.911441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:01.913065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:01.928040 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1176/2336] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:01.929641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:01.940979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dff67-0793-4abc-a605-1745165ef6ca admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:01.946553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:01.947608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:01.947880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:01.948150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] PATH_INFO: `/v3/projects/e4cbc27fec694768932827b043864061/users/5ea62c5fa4054a0ea2af2fcd4c957528/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:01.961207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b1dd16c0024e28a7ce1316453bf9c3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.964625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b1dd16c0024e28a7ce1316453bf9c3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.965330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b1dd16c0024e28a7ce1316453bf9c3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:01.969850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cbc27fec694768932827b043864061, user_id=5ea62c5fa4054a0ea2af2fcd4c957528, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:01.972888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:01.975002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7c724c76-9989-4927-8dbc-4f6ee270a6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b1dd16c0024e28a7ce1316453bf9c3'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:02.004759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1161/2337] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:01 2022] DELETE /identity/v3/users/a7b1dd16c0024e28a7ce1316453bf9c3 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:02.047880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1177/2338] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:01 2022] PUT /identity/v3/projects/e4cbc27fec694768932827b043864061/users/5ea62c5fa4054a0ea2af2fcd4c957528/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:02.062412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e7ae-2251-4442-8e24-6489d6eab930 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:02.063109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e7ae-2251-4442-8e24-6489d6eab930 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:02.063544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e7ae-2251-4442-8e24-6489d6eab930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:02.138553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6983e7ae-2251-4442-8e24-6489d6eab930 None None] MFA Rules not processed for user `5ea62c5fa4054a0ea2af2fcd4c957528`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:02.141402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6983e7ae-2251-4442-8e24-6489d6eab930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:02.327196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1162/2339] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:02.331575 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:02.333643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:02.420491 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a448a18-5a5d-4344-8dca-7f1fdb1dcd23 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:02.426070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:02.427706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:02.428220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:02.428744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:02.429607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:02.432401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:02.519515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1178/2340] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:02 2022] POST /identity/v3/projects => generated 391 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:02.520567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983e7ae-2251-4442-8e24-6489d6eab930 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:02.540879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983e7ae-2251-4442-8e24-6489d6eab930 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:02.598108 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:02.601181 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:02.716285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:02.717490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:02.718006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:02.718504 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:02.719460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:02.721609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:02.731481 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f55d8-6bf7-4882-a44c-81355996d805 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:02.745334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:02.746201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:02.746478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:02.746750 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] PATH_INFO: `/v3/projects/6ed66573118a4c8199b0dadc75bea461` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:02.752207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed66573118a4c8199b0dadc75bea461)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:02.754163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:02.822460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1163/2341] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:02 2022] POST /identity/v3/users => generated 302 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:02.823715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:02.842558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36ff81-6a55-4442-9c3e-ec258236b852 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:02.859891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:02.860859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:02.861397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:02.862562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:02.864279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:02.868571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:02.884269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed66573118a4c8199b0dadc75bea461', 'request_id': 'req-3678c9b7-ea75-4ce7-ad3e-282098486b98'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:02.896912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed66573118a4c8199b0dadc75bea461', 'request_id': 'req-3678c9b7-ea75-4ce7-ad3e-282098486b98'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:02.902994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1164/2342] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:02.905836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:02.929428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53d257-12f4-419e-a8f0-fdc07a57344b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:02.981299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed66573118a4c8199b0dadc75bea461', 'request_id': 'req-3678c9b7-ea75-4ce7-ad3e-282098486b98'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:02.995884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] The token cache is being invalidate because project 6ed66573118a4c8199b0dadc75bea461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:03.000341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:03.001233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3678c9b7-ea75-4ce7-ad3e-282098486b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:03.003536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1179/2343] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:02 2022] DELETE /identity/v3/projects/6ed66573118a4c8199b0dadc75bea461 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:03.010576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145dd8-b1aa-4403-8428-85aac262f304 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.011176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145dd8-b1aa-4403-8428-85aac262f304 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.011623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2145dd8-b1aa-4403-8428-85aac262f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.061966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d2145dd8-b1aa-4403-8428-85aac262f304 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:03.073428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d2145dd8-b1aa-4403-8428-85aac262f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:03.101765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.101765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.101765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.101765 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] PATH_INFO: `/v3/projects/020839c3c9cd4f62a8c7544b8952ab5e/users/3f1a749b56f04e2b802f25b8758e56fe/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.139712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=020839c3c9cd4f62a8c7544b8952ab5e, user_id=3f1a749b56f04e2b802f25b8758e56fe, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.143179 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.178856 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1180/2344] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:03.182102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40cf2-50e2-4d1b-9831-963b5a78953f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.182472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40cf2-50e2-4d1b-9831-963b5a78953f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.182644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c40cf2-50e2-4d1b-9831-963b5a78953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.208634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c1c40cf2-50e2-4d1b-9831-963b5a78953f None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:03.210667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1165/2345] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:02 2022] PUT /identity/v3/projects/020839c3c9cd4f62a8c7544b8952ab5e/users/3f1a749b56f04e2b802f25b8758e56fe/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:03.211329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c1c40cf2-50e2-4d1b-9831-963b5a78953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:03.222975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.222975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:03.300505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dec2c-a3bc-4eaf-be88-2af1645ed98d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.310645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.310863 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1181/2346] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:03.310983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.310983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.311259 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40cf2-50e2-4d1b-9831-963b5a78953f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.311366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.311366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.311366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.319389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c40cf2-50e2-4d1b-9831-963b5a78953f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.322579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1166/2347] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:03.328498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.329550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.330454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.330908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.333758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.333758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:03.333758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.335572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.340329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6331d2e-dc37-4d93-a389-4219077b60ed admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.346459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7af9a6-8139-48bf-9058-deb7f13dbd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.347949 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af9a6-8139-48bf-9058-deb7f13dbd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.347949 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af9a6-8139-48bf-9058-deb7f13dbd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.347949 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7af9a6-8139-48bf-9058-deb7f13dbd7c admin admin] PATH_INFO: `/v3/projects/020839c3c9cd4f62a8c7544b8952ab5e/users/3f1a749b56f04e2b802f25b8758e56fe/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.350356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7af9a6-8139-48bf-9058-deb7f13dbd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=020839c3c9cd4f62a8c7544b8952ab5e, user_id=3f1a749b56f04e2b802f25b8758e56fe, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.354037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7af9a6-8139-48bf-9058-deb7f13dbd7c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.366634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1182/2348] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:03.372815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.381058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1167/2349] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:03 2022] PUT /identity/v3/projects/020839c3c9cd4f62a8c7544b8952ab5e/users/3f1a749b56f04e2b802f25b8758e56fe/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:03.385482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.385482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.385482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.392791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292bae7-4c82-4a33-8f3f-a4995b60d327 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.423438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] MFA Rules not processed for user `3f1a749b56f04e2b802f25b8758e56fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:03.424683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:03.478846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.479958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.480334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.480622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.481357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.483396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.533656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1168/2350] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:03.546609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.551633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:03.570541 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1183/2351] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:03 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:03.575992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.662222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd295d48-d0fd-492a-b917-ae27795f9f97 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.675315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10fe5f-ebe6-49cc-92f4-aebd8109e87e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.688135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.689107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.689473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.690087 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.690664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.692831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.729980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.730972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.731355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.731730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.760289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1184/2352] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:03 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:03.764509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.775153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcfdd-41ca-46e3-a852-077dec9ecb72 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.780224 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.780890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.781169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.781444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.782188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.783821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.797280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1185/2353] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:03.798226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.810146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23adead-598b-4d80-8546-d241f431d4bf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.815352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.815818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.816202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.816330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.817189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.818836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.826337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.828383 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.834012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1186/2354] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:03.834907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.845630 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b539d-ca5a-4d91-aabe-134104788a5b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.848187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1169/2355] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:03.850530 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f0d6-9066-4ea4-84ea-93ea3c41982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.851571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f0d6-9066-4ea4-84ea-93ea3c41982b admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.851865 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f0d6-9066-4ea4-84ea-93ea3c41982b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.852144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f0d6-9066-4ea4-84ea-93ea3c41982b admin admin] PATH_INFO: `/v3/projects/63c0e8b8bbe84b11aef5cfb94372763a/users/de2cf41279fa4dc280e869f708ec1af4/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.874604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752f0d6-9066-4ea4-84ea-93ea3c41982b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c0e8b8bbe84b11aef5cfb94372763a, user_id=de2cf41279fa4dc280e869f708ec1af4, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:03.878083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752f0d6-9066-4ea4-84ea-93ea3c41982b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:03.894516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:03.896136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:03.907961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fa04b-6501-4332-931d-ac0ee871edcd service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:03.911928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:03.912718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.913117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.913482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.917104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:03.971487 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1187/2356] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:03 2022] PUT /identity/v3/projects/63c0e8b8bbe84b11aef5cfb94372763a/users/de2cf41279fa4dc280e869f708ec1af4/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:03.973048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbafb2-bb62-4c33-9d40-ed1ef0c75d80 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:03.973344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbafb2-bb62-4c33-9d40-ed1ef0c75d80 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:03.973781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbafb2-bb62-4c33-9d40-ed1ef0c75d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:03.999376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:04.001012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:04.013400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7cfbafb2-bb62-4c33-9d40-ed1ef0c75d80 None None] MFA Rules not processed for user `de2cf41279fa4dc280e869f708ec1af4`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:04.014744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1170/2357] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:04.025347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7cfbafb2-bb62-4c33-9d40-ed1ef0c75d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:04.126098 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1188/2358] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:04.131313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:04.145554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e4d28-5835-448c-b1b6-09cb94926aad service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:04.241051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:04.241722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:04.242004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:04.242280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:04.243599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:04.245562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:04.361443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1171/2359] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:04 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:04.367145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbafb2-bb62-4c33-9d40-ed1ef0c75d80 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:04.385784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbafb2-bb62-4c33-9d40-ed1ef0c75d80 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:04.474935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:04.479261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:04.480065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:04.480065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:04.483007 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:04.485231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:04.572072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1189/2360] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:04 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:04.576126 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:04.589884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cb83c-6e72-4984-ac35-a7a002289676 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:04.599394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:04.600252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:04.600697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:04.601133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:04.602568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:04.604406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:04.618920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1172/2361] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:04.621210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:04.632801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440ca29-d341-4e46-92c4-364d9f61b59c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:04.638421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:04.639374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:04.639658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:04.639934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] PATH_INFO: `/v3/projects/1576bc87e0014b1aaf3164b4454f8f55/users/ab1a734f2ce04af1900a9bc914372001/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:04.674294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1576bc87e0014b1aaf3164b4454f8f55, user_id=ab1a734f2ce04af1900a9bc914372001, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:04.676566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:04.748419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1190/2362] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:04 2022] PUT /identity/v3/projects/1576bc87e0014b1aaf3164b4454f8f55/users/ab1a734f2ce04af1900a9bc914372001/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:04.756325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:04.775938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2794705-ecd7-4ef9-9c75-3b4f351a3727 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:04.856627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3184f-9dd3-4638-83e9-2062ebbb0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:04.857310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3184f-9dd3-4638-83e9-2062ebbb0cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:04.857909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3184f-9dd3-4638-83e9-2062ebbb0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:04.857909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3184f-9dd3-4638-83e9-2062ebbb0cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:04.858698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3184f-9dd3-4638-83e9-2062ebbb0cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:04.860441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3184f-9dd3-4638-83e9-2062ebbb0cf4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:04.872371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1173/2363] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:04.876671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:04.897206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6422f3e-a9c0-4ea5-96df-277a40cb501a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:04.903504 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:04.904461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:04.904935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:04.905355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] PATH_INFO: `/v3/projects/1576bc87e0014b1aaf3164b4454f8f55/users/ab1a734f2ce04af1900a9bc914372001/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:04.908269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1576bc87e0014b1aaf3164b4454f8f55, user_id=ab1a734f2ce04af1900a9bc914372001, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:04.911192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:04.926877 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1191/2364] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:04 2022] PUT /identity/v3/projects/1576bc87e0014b1aaf3164b4454f8f55/users/ab1a734f2ce04af1900a9bc914372001/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:04.934083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0d08-cfa1-4d78-bbc6-439fd4d189a9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:04.934382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0d08-cfa1-4d78-bbc6-439fd4d189a9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:04.934657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0d08-cfa1-4d78-bbc6-439fd4d189a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:04.972417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-402d0d08-cfa1-4d78-bbc6-439fd4d189a9 None None] MFA Rules not processed for user `ab1a734f2ce04af1900a9bc914372001`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:04.973671 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-402d0d08-cfa1-4d78-bbc6-439fd4d189a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:05.057032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1174/2365] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:05.063807 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:05.132866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c2af6-0316-4a7e-a803-dc3c59618750 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:05.136911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:05.137800 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:05.138146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:05.138506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:05.151031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:05.152943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:05.167975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1192/2366] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:05.322868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d0d08-cfa1-4d78-bbc6-439fd4d189a9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:05.333236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d0d08-cfa1-4d78-bbc6-439fd4d189a9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:05.337401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3553bd-2bb8-4795-a6c4-71d5db2487ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:05.338203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3553bd-2bb8-4795-a6c4-71d5db2487ad service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:05.338591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3553bd-2bb8-4795-a6c4-71d5db2487ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:05.338991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3553bd-2bb8-4795-a6c4-71d5db2487ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:05.428094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3553bd-2bb8-4795-a6c4-71d5db2487ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:05.431043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3553bd-2bb8-4795-a6c4-71d5db2487ad service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:05.448405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1175/2367] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:06.262811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:06.351313 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2bbbc-5d9b-49d1-9c75-5a1dd99fb1b0 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:06.358588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:06.359850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:06.360132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:06.360412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] PATH_INFO: `/v3/users/de2cf41279fa4dc280e869f708ec1af4` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:06.361984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2cf41279fa4dc280e869f708ec1af4)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:06.364084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:06.602036 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2cf41279fa4dc280e869f708ec1af4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:06.603717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2cf41279fa4dc280e869f708ec1af4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:06.635578 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2cf41279fa4dc280e869f708ec1af4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:06.654183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2cf41279fa4dc280e869f708ec1af4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:06.757772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2cf41279fa4dc280e869f708ec1af4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:06.766147 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1193/2368] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:06 2022] DELETE /identity/v3/users/de2cf41279fa4dc280e869f708ec1af4 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:06.770937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:06.771420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:06.771538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:06.793635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:06.795256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:06.889261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1176/2369] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:06.900495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:06.905719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:06.972428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafbd02-4139-4629-a977-99d1e4cf176c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:06.978045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:06.978693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:06.979011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:06.979290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:06.990171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:06.991754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:07.006736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1194/2370] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:07.463583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:07.465163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:07.489172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860f963-0d9b-44cb-985f-00e3c3862533 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:07.499370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:07.501768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:07.502655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:07.503413 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] PATH_INFO: `/v3/projects/63c0e8b8bbe84b11aef5cfb94372763a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:07.505717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c0e8b8bbe84b11aef5cfb94372763a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:07.507979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:07.623928 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c0e8b8bbe84b11aef5cfb94372763a', 'request_id': 'req-b8b3047c-28b7-4296-97a2-c0272f56679a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:07.684614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c0e8b8bbe84b11aef5cfb94372763a', 'request_id': 'req-b8b3047c-28b7-4296-97a2-c0272f56679a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:07.692337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c0e8b8bbe84b11aef5cfb94372763a', 'request_id': 'req-b8b3047c-28b7-4296-97a2-c0272f56679a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:07.709894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] The token cache is being invalidate because project 63c0e8b8bbe84b11aef5cfb94372763a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:07.715941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:07.715941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:07.722886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1177/2371] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:07 2022] DELETE /identity/v3/projects/63c0e8b8bbe84b11aef5cfb94372763a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:07.727894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:07.740289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795d54-3db4-446b-b8e9-64fb81b38372 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:07.846355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:07.847270 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:07.847600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:07.848072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] PATH_INFO: `/v3/users/ab1a734f2ce04af1900a9bc914372001` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:07.851511 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1a734f2ce04af1900a9bc914372001)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:07.854652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:08.076102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1a734f2ce04af1900a9bc914372001'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.076780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1a734f2ce04af1900a9bc914372001'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.095267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1a734f2ce04af1900a9bc914372001'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.105114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1a734f2ce04af1900a9bc914372001'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.177047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-3720b5b3-e113-4130-8416-e55d1d1c53ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1a734f2ce04af1900a9bc914372001'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.187202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1195/2372] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:07 2022] DELETE /identity/v3/users/ab1a734f2ce04af1900a9bc914372001 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:08.658606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:08.660273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:08.700416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3047c-28b7-4296-97a2-c0272f56679a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:08.770002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:08.771327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:08.771800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:08.772080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] PATH_INFO: `/v3/projects/1576bc87e0014b1aaf3164b4454f8f55` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:08.774191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1576bc87e0014b1aaf3164b4454f8f55)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:08.776869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:08.889708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1576bc87e0014b1aaf3164b4454f8f55', 'request_id': 'req-57d7b926-0752-46cf-853d-edea433aaa95'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.935908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1576bc87e0014b1aaf3164b4454f8f55', 'request_id': 'req-57d7b926-0752-46cf-853d-edea433aaa95'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.943816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1576bc87e0014b1aaf3164b4454f8f55', 'request_id': 'req-57d7b926-0752-46cf-853d-edea433aaa95'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.962285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] The token cache is being invalidate because project 1576bc87e0014b1aaf3164b4454f8f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:08.962595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.963463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-57d7b926-0752-46cf-853d-edea433aaa95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:08.965286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1178/2373] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:08 2022] DELETE /identity/v3/projects/1576bc87e0014b1aaf3164b4454f8f55 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:08.972717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffff9-6d6a-4cda-9717-f8f2a6853eca None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:08.973894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffff9-6d6a-4cda-9717-f8f2a6853eca None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:08.974373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ffff9-6d6a-4cda-9717-f8f2a6853eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:08.999971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-309ffff9-6d6a-4cda-9717-f8f2a6853eca None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:09.001326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-309ffff9-6d6a-4cda-9717-f8f2a6853eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:09.188502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1196/2374] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:09.197933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e1c66-8c0b-4853-984f-6cc3dfcf99d1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:09.198256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e1c66-8c0b-4853-984f-6cc3dfcf99d1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:09.198516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e1c66-8c0b-4853-984f-6cc3dfcf99d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:09.237900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bc2e1c66-8c0b-4853-984f-6cc3dfcf99d1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:09.239252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bc2e1c66-8c0b-4853-984f-6cc3dfcf99d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:09.248673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1179/2375] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:09.253757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffff9-6d6a-4cda-9717-f8f2a6853eca None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:09.264660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ffff9-6d6a-4cda-9717-f8f2a6853eca None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:09.272882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:09.285978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:09.285978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:09.285978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:09.285978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:09.285978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:09.285978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:09.291233 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1197/2376] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:50:09.295584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e1c66-8c0b-4853-984f-6cc3dfcf99d1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:09.310537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e1c66-8c0b-4853-984f-6cc3dfcf99d1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:09.315626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:09.316268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:09.316553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:09.316831 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:09.317552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:09.319531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:09.600660 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1180/2377] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:09 2022] POST /identity/v3/projects => generated 383 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:09.604978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:09.615053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bca31-34b9-4b4e-9b39-b459028d10fe admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:09.676648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:09.677557 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:09.677773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:09.678021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:09.678875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:09.684128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:09.765779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1198/2378] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:09 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:09.771424 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:09.789893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd357-426f-4eac-bd57-38a81739e668 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:09.795544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:09.796295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:09.796651 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:09.796929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:09.797703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:09.800095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:09.815602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1181/2379] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:09.819084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:09.831279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7d6d4-3762-4a65-a652-166a5ec73e95 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:09.836793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce04aae-f4bd-4c75-918e-48425a5f1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:09.837532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce04aae-f4bd-4c75-918e-48425a5f1e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:09.837823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce04aae-f4bd-4c75-918e-48425a5f1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:09.838082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce04aae-f4bd-4c75-918e-48425a5f1e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:09.838855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce04aae-f4bd-4c75-918e-48425a5f1e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:09.840462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce04aae-f4bd-4c75-918e-48425a5f1e84 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:09.857049 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1199/2380] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:09.861080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:09.872842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61238fd3-1d90-4081-960a-6336dd62677b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:09.879640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:09.880519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:09.880802 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:09.881077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] PATH_INFO: `/v3/projects/95e6b6243fa04323abfd692418dcbd7a/users/a06027a8c2494d95879d6a1e7acc229c/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:09.903176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e6b6243fa04323abfd692418dcbd7a, user_id=a06027a8c2494d95879d6a1e7acc229c, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:09.906100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:09.993442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1182/2381] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:09 2022] PUT /identity/v3/projects/95e6b6243fa04323abfd692418dcbd7a/users/a06027a8c2494d95879d6a1e7acc229c/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:10.005414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.006027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.006027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.040762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] MFA Rules not processed for user `a06027a8c2494d95879d6a1e7acc229c`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:10.042128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:10.125869 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1200/2382] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:10.130819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.204740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.206187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:10.208841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033a2d5-5976-47e4-8767-744665b22433 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.227790 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.228575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.228922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.229277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.230289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.232434 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.247436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429021ab-e3c1-432c-b5a3-ead6d019faf0 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.262627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.264605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.265027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.265371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] PATH_INFO: `/v3/users/5ea62c5fa4054a0ea2af2fcd4c957528` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.267022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea62c5fa4054a0ea2af2fcd4c957528)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.268968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.316969 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1183/2383] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:10 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:10.319646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.393868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26ab4d-7116-4df6-953c-78223e7abb1a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.399109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.399857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.400108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.400376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.401078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.403016 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.585201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1184/2384] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:10 2022] POST /identity/v3/users => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:10.595583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.609950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e36e8-ca7e-4dab-be1e-5d26f6c6e023 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.622470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.622470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.622470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.622470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.623482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.623482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.634467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1185/2385] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:10.637052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea62c5fa4054a0ea2af2fcd4c957528'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:10.640658 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea62c5fa4054a0ea2af2fcd4c957528'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:10.640802 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.650707 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddddc0a-df68-4a45-b658-984429e5b7e0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.651365 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea62c5fa4054a0ea2af2fcd4c957528'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:10.655745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.656724 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.657115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.657496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] PATH_INFO: `/v3/projects/05901fc64f0641d0935426356311dd87/users/cb477b141a2140cca076fedaa0c9e183/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.659202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea62c5fa4054a0ea2af2fcd4c957528'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:10.678649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05901fc64f0641d0935426356311dd87, user_id=cb477b141a2140cca076fedaa0c9e183, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.681720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.715555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5e155a12-4dc9-4b45-af4d-d45918d36ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea62c5fa4054a0ea2af2fcd4c957528'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:10.722277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1201/2386] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:10 2022] DELETE /identity/v3/users/5ea62c5fa4054a0ea2af2fcd4c957528 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:10.726373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.726965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.727369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.745391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:10.746587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:10.765107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1186/2387] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:10 2022] PUT /identity/v3/projects/05901fc64f0641d0935426356311dd87/users/cb477b141a2140cca076fedaa0c9e183/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:10.769784 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.774384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:10.821567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1202/2388] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:10.831104 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.832715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:10.845932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfeddd-5c3a-4d60-a45e-46d78eea9d6d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.851094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.851805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.852090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.852389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.853271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.854977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.865435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1187/2389] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:10.870123 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:10.880949 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcded91d-9978-4be9-a2a1-58b3eb478907 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.886331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d68fb8-6942-4b1a-ab2c-bbde27ceecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.890344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d68fb8-6942-4b1a-ab2c-bbde27ceecc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.890344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d68fb8-6942-4b1a-ab2c-bbde27ceecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.890344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d68fb8-6942-4b1a-ab2c-bbde27ceecc4 admin admin] PATH_INFO: `/v3/projects/05901fc64f0641d0935426356311dd87/users/cb477b141a2140cca076fedaa0c9e183/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.890344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d68fb8-6942-4b1a-ab2c-bbde27ceecc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05901fc64f0641d0935426356311dd87, user_id=cb477b141a2140cca076fedaa0c9e183, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.892690 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d68fb8-6942-4b1a-ab2c-bbde27ceecc4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.897232 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabaf550-00ca-4555-8e22-832244cece62 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:10.905256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1188/2390] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:10 2022] PUT /identity/v3/projects/05901fc64f0641d0935426356311dd87/users/cb477b141a2140cca076fedaa0c9e183/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:10.907429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.907722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.907995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.926639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:10.927886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:10.949304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb934c-179e-4f40-acf6-634b33dce835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:10.949984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb934c-179e-4f40-acf6-634b33dce835 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.950268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb934c-179e-4f40-acf6-634b33dce835 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.950543 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb934c-179e-4f40-acf6-634b33dce835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.960042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb934c-179e-4f40-acf6-634b33dce835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:10.961515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb934c-179e-4f40-acf6-634b33dce835 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:10.970977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1203/2391] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:10.972240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:10.972497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:10.972771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:10.988169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1189/2392] 10.222.0.21 () {58 vars in 967 bytes} [Mon Jan 31 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:11.001822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:11.003550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:11.005349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] MFA Rules not processed for user `cb477b141a2140cca076fedaa0c9e183`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:11.006960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:11.079769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7907-881d-4e31-bb8b-37df390d5d42 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:11.085239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:11.085992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:11.086821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:11.087089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:11.095641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1204/2393] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:11.096362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:11.098007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:11.100453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:11.102418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:11.107523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1190/2394] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:50:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:50:11.168282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec43d91-6d22-4dae-9d59-d920b373b907 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:11.171871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:11.172494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:11.172767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:11.173034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:11.174967 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:11.237911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:11.239444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:11.252159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1205/2395] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:11.457554 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:11.459138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:11.538204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f31524-e4b4-4f21-bfd8-5af3ea11afdc service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:11.542947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:11.543802 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:11.544083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:11.544358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] PATH_INFO: `/v3/projects/e4cbc27fec694768932827b043864061` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:11.545601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cbc27fec694768932827b043864061)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:11.547556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:11.673158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cbc27fec694768932827b043864061', 'request_id': 'req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:11.758903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cbc27fec694768932827b043864061', 'request_id': 'req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:11.765726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cbc27fec694768932827b043864061', 'request_id': 'req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:11.777965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] The token cache is being invalidate because project e4cbc27fec694768932827b043864061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:11.778642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:11.779044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:11.780595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1191/2396] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:11 2022] DELETE /identity/v3/projects/e4cbc27fec694768932827b043864061 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:11.784544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:11.795849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1264e4-360f-48ad-8156-7daf7b993ca5 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:11.857820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:11.858685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:11.858995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:11.859267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] PATH_INFO: `/v3/users/3f1a749b56f04e2b802f25b8758e56fe` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:11.860559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1a749b56f04e2b802f25b8758e56fe)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:11.862502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:12.062972 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1a749b56f04e2b802f25b8758e56fe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.063744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1a749b56f04e2b802f25b8758e56fe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.076323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1a749b56f04e2b802f25b8758e56fe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.088381 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1a749b56f04e2b802f25b8758e56fe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.164645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-2408fb11-3528-4c95-b8b3-00cc8fc9df42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1a749b56f04e2b802f25b8758e56fe'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.171330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1206/2397] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:11 2022] DELETE /identity/v3/users/3f1a749b56f04e2b802f25b8758e56fe => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:12.605730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:12.607296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:12.620984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d82f5-78cc-45e9-bcd1-6fbf044934fb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:12.690514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:12.694298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:12.694633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:12.694939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] PATH_INFO: `/v3/projects/020839c3c9cd4f62a8c7544b8952ab5e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:12.697012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020839c3c9cd4f62a8c7544b8952ab5e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:12.698946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:12.850713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020839c3c9cd4f62a8c7544b8952ab5e', 'request_id': 'req-38b902b9-7382-4253-8a35-a027f9efbca8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.935360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020839c3c9cd4f62a8c7544b8952ab5e', 'request_id': 'req-38b902b9-7382-4253-8a35-a027f9efbca8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.942316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020839c3c9cd4f62a8c7544b8952ab5e', 'request_id': 'req-38b902b9-7382-4253-8a35-a027f9efbca8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.952685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] The token cache is being invalidate because project 020839c3c9cd4f62a8c7544b8952ab5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:12.952966 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.953610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-38b902b9-7382-4253-8a35-a027f9efbca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:12.955433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1192/2398] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:12 2022] DELETE /identity/v3/projects/020839c3c9cd4f62a8c7544b8952ab5e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:12.961464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88c09-4441-4695-97b5-a902aed8f746 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:12.962102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88c09-4441-4695-97b5-a902aed8f746 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:12.962417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d88c09-4441-4695-97b5-a902aed8f746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:12.980608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a6d88c09-4441-4695-97b5-a902aed8f746 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:12.981895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a6d88c09-4441-4695-97b5-a902aed8f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:13.044051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1207/2399] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:13.052738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8871-b17b-402f-a87e-b6f3e645e092 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.053032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8871-b17b-402f-a87e-b6f3e645e092 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.053433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8871-b17b-402f-a87e-b6f3e645e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.072298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-dd0b8871-b17b-402f-a87e-b6f3e645e092 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:13.073542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-dd0b8871-b17b-402f-a87e-b6f3e645e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:13.089992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1193/2400] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:13.090999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88c09-4441-4695-97b5-a902aed8f746 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:13.102998 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d88c09-4441-4695-97b5-a902aed8f746 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:13.107971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:13.108622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.108900 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.109167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.109898 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:13.110196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:13.111878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:13.128961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1208/2401] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:50:13.130154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8871-b17b-402f-a87e-b6f3e645e092 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:13.139463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8871-b17b-402f-a87e-b6f3e645e092 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:13.144269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:13.144909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.145191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.145464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.146169 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:13.148100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:13.268856 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1194/2402] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:13 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:13.273022 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:13.285226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4b5c2-a7fb-410e-a3b5-aaa2d5433100 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:13.342692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:13.343384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.343662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.343937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.344635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:13.346660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:13.502143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1209/2403] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:13 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:13.506188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:13.517902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17a33-d88a-4add-a7bb-00b66e05bac7 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:13.523188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:13.524822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.525111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.525388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.526134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:13.527763 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:13.538717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1195/2404] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:13.544295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:13.554287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554360a-4fa5-4a79-b395-b08ca9f417a5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:13.559226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74757cf2-deb1-482a-b56b-245546c28069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:13.559876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74757cf2-deb1-482a-b56b-245546c28069 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.560158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74757cf2-deb1-482a-b56b-245546c28069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.560435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74757cf2-deb1-482a-b56b-245546c28069 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.561167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74757cf2-deb1-482a-b56b-245546c28069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:13.562766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74757cf2-deb1-482a-b56b-245546c28069 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:13.573804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1210/2405] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:13.583280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:13.597992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f6178-3539-4643-b2e0-c6a39eb3c27d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:13.603057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:13.609100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.609100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.609100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] PATH_INFO: `/v3/projects/c18e66056ea94f8a8d1d6643b33ef80e/users/9ba2597d18244961bfe0a817720da132/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.621961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18e66056ea94f8a8d1d6643b33ef80e, user_id=9ba2597d18244961bfe0a817720da132, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:13.624636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:13.761456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1196/2406] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:13 2022] PUT /identity/v3/projects/c18e66056ea94f8a8d1d6643b33ef80e/users/9ba2597d18244961bfe0a817720da132/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:13.762966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f25c-bd7c-47a5-adf8-e1cdfafcddf6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.763244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f25c-bd7c-47a5-adf8-e1cdfafcddf6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.766946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f25c-bd7c-47a5-adf8-e1cdfafcddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.803198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a327f25c-bd7c-47a5-adf8-e1cdfafcddf6 None None] MFA Rules not processed for user `9ba2597d18244961bfe0a817720da132`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:13.804416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a327f25c-bd7c-47a5-adf8-e1cdfafcddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:13.882688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1211/2407] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:13.887319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:13.963080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19267-6bd7-4b56-82ad-36dd58da7a25 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:13.968210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:13.968866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:13.969347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:13.969642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:13.970360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:13.973328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.081703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1197/2408] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:13 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:14.089810 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f25c-bd7c-47a5-adf8-e1cdfafcddf6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:14.107885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f25c-bd7c-47a5-adf8-e1cdfafcddf6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:14.220471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:14.221409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.221678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.222025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.222844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:14.224874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.368654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1212/2409] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:14 2022] POST /identity/v3/users => generated 301 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:14.369965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:14.385109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5f2e6-c2c8-470e-be52-0d26536cff84 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:14.390046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:14.390715 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.391043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.391325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.392064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:14.393720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.405842 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1198/2410] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:14.410079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:14.421265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a4e65-801b-413a-b41d-33db1f8a717e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:14.426305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:14.427268 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.427673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.427955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] PATH_INFO: `/v3/projects/280d67ff9a51470e881bc4bd9e9b0f38/users/7ab0013572934fb38f3d65f15a842fcb/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.445279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280d67ff9a51470e881bc4bd9e9b0f38, user_id=7ab0013572934fb38f3d65f15a842fcb, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:14.448788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.525127 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1213/2411] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:14 2022] PUT /identity/v3/projects/280d67ff9a51470e881bc4bd9e9b0f38/users/7ab0013572934fb38f3d65f15a842fcb/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:14.529230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:14.539014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35b701-6721-46b9-b382-f4e3afb9f77d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:14.561173 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:14.564114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:14.600813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:14.601517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.601927 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.602416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.603341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:14.604948 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.618958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1199/2412] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:14.620376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:14.630449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cca66-a91b-4233-b15e-afb73ea72f7a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:14.635973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f454ef-dc4f-4183-8db7-e95581726828 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:14.636142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4555c-e9f6-4022-b04f-4fa23bac7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:14.636849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4555c-e9f6-4022-b04f-4fa23bac7292 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.637127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4555c-e9f6-4022-b04f-4fa23bac7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.637399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4555c-e9f6-4022-b04f-4fa23bac7292 admin admin] PATH_INFO: `/v3/projects/280d67ff9a51470e881bc4bd9e9b0f38/users/7ab0013572934fb38f3d65f15a842fcb/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.639417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4555c-e9f6-4022-b04f-4fa23bac7292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280d67ff9a51470e881bc4bd9e9b0f38, user_id=7ab0013572934fb38f3d65f15a842fcb, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:14.640783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:14.641696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.641971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.642120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4555c-e9f6-4022-b04f-4fa23bac7292 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.642229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] PATH_INFO: `/v3/users/e7557280caf846d6bdd96d80e1d28333` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.643565 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7557280caf846d6bdd96d80e1d28333)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:14.645452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.652235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1200/2413] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:14 2022] PUT /identity/v3/projects/280d67ff9a51470e881bc4bd9e9b0f38/users/7ab0013572934fb38f3d65f15a842fcb/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:14.663136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.663423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.663692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.691409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] MFA Rules not processed for user `7ab0013572934fb38f3d65f15a842fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:14.692624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:14.759957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1201/2414] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:14.797195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:14.803095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:14.857182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7557280caf846d6bdd96d80e1d28333'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:14.857738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7557280caf846d6bdd96d80e1d28333'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:14.859300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97152b8-9b61-4b36-b89e-34b5b46e94e4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:14.862901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:14.863560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:14.863820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:14.864090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:14.870107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7557280caf846d6bdd96d80e1d28333'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:14.873548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:14.875006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:14.877450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7557280caf846d6bdd96d80e1d28333'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:14.886745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1202/2415] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:14.958623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7557280caf846d6bdd96d80e1d28333'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:14.966221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1214/2416] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:14 2022] DELETE /identity/v3/users/e7557280caf846d6bdd96d80e1d28333 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:15.021155 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.085937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fee48-bf6e-4666-bd5a-66ceff52e39e service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.143664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.144570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.144853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.145132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] PATH_INFO: `/v3/users/9ba2597d18244961bfe0a817720da132` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.146456 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba2597d18244961bfe0a817720da132)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.148439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.228742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.230739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:15.256029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d01fe2-74f0-4d27-b3d0-56eeeb082ba3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.261412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.262527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.262910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.263288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] PATH_INFO: `/v3/projects/30fced24126f40ac94f018df7c960a15` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.264754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fced24126f40ac94f018df7c960a15)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.266945 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.338627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba2597d18244961bfe0a817720da132'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.370523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fced24126f40ac94f018df7c960a15', 'request_id': 'req-a1144fd1-ffad-4e50-879f-21dc89cc174f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.376241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fced24126f40ac94f018df7c960a15', 'request_id': 'req-a1144fd1-ffad-4e50-879f-21dc89cc174f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.404832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba2597d18244961bfe0a817720da132'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.405457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba2597d18244961bfe0a817720da132'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.406062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba2597d18244961bfe0a817720da132'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.413278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5a02e12d-9f91-4e05-b10d-5a40f3d80957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba2597d18244961bfe0a817720da132'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.430655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1203/2417] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:15 2022] DELETE /identity/v3/users/9ba2597d18244961bfe0a817720da132 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:15.434873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.435161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.435439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.452225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:15.453425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:15.484824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fced24126f40ac94f018df7c960a15', 'request_id': 'req-a1144fd1-ffad-4e50-879f-21dc89cc174f'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.498585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] The token cache is being invalidate because project 30fced24126f40ac94f018df7c960a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:15.498937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.499574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1144fd1-ffad-4e50-879f-21dc89cc174f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:15.501211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1215/2418] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:15 2022] DELETE /identity/v3/projects/30fced24126f40ac94f018df7c960a15 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:15.507055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6892b-99ce-4e0a-970a-33a81cb073ba None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.507985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6892b-99ce-4e0a-970a-33a81cb073ba None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.508377 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6892b-99ce-4e0a-970a-33a81cb073ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.513875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1204/2419] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:15.526216 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.527603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:15.528057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a9c6892b-99ce-4e0a-970a-33a81cb073ba None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:15.529234 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a9c6892b-99ce-4e0a-970a-33a81cb073ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:15.537266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1216/2420] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:15.546690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f0f3-a364-44d9-9c6c-18de2ed27fad None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.547002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f0f3-a364-44d9-9c6c-18de2ed27fad None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.547283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6f0f3-a364-44d9-9c6c-18de2ed27fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.566848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e0f6f0f3-a364-44d9-9c6c-18de2ed27fad None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:15.568056 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e0f6f0f3-a364-44d9-9c6c-18de2ed27fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:15.578484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1217/2421] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:15.582660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f0f3-a364-44d9-9c6c-18de2ed27fad None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.585228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b90f2-2ae0-4086-b471-be8c1198a475 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.590193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.590881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.591166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.591443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.592968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6f0f3-a364-44d9-9c6c-18de2ed27fad None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.598066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.598711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.599020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.599296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.600067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:15.600434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.601082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.603186 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.606823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.614837 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1218/2422] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:15.615024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1205/2423] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:15.619330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.629513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6309b8-67f5-451a-b1c8-550f2e51d198 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.634683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.635356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.635668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.635940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.636654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.638534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.749283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1219/2424] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:15 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:15.753659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.763918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48fffb-f86e-434d-91d4-2a2ac187d51b service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.817879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.818565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.818882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.819181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.819924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.822508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.892100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1206/2425] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:15 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:15.896125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.907130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c42177-429f-490f-ba31-389719c9721b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.911891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.912544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.912817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.913086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.913817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.915554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.925540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1220/2426] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:15.929459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.939266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df1937-3ef5-454b-b033-f34358be135f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.943881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.944462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.944741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.945078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.946292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.948047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:15.958112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1207/2427] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:15.962218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:15.972458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca182a7-5f55-40b6-b956-3b6133f95afb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:15.977823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d74b3-1b68-45df-bd61-59809d25679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:15.978718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d74b3-1b68-45df-bd61-59809d25679c admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:15.979016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d74b3-1b68-45df-bd61-59809d25679c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:15.979284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d74b3-1b68-45df-bd61-59809d25679c admin admin] PATH_INFO: `/v3/projects/584202b5b2364b31a0c0b9214bbe5007/users/6f9cef0d94d94d27bf2ef9b0263acae9/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:15.995047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d74b3-1b68-45df-bd61-59809d25679c admin admin] RBAC: Authorizing `identity:create_grant(project_id=584202b5b2364b31a0c0b9214bbe5007, user_id=6f9cef0d94d94d27bf2ef9b0263acae9, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:15.997773 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d74b3-1b68-45df-bd61-59809d25679c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:16.078445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1221/2428] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:15 2022] PUT /identity/v3/projects/584202b5b2364b31a0c0b9214bbe5007/users/6f9cef0d94d94d27bf2ef9b0263acae9/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:16.079536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:16.084655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:16.095683 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:16.096012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:16.096273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:16.116199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ba40d-6309-4df0-89c5-45ea39d29fa0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:16.132725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] MFA Rules not processed for user `6f9cef0d94d94d27bf2ef9b0263acae9`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:16.134152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:16.175427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:16.176324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:16.176636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:16.176903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] PATH_INFO: `/v3/projects/c18e66056ea94f8a8d1d6643b33ef80e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:16.178083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18e66056ea94f8a8d1d6643b33ef80e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:16.180661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:16.203517 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1222/2429] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:16.209445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:16.210784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:16.265361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654e61a-e542-4743-93ab-86a1e8bcf989 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:16.268963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:16.269593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:16.269867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:16.270137 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:16.278881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:16.280245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:16.289413 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1223/2430] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:16.314472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18e66056ea94f8a8d1d6643b33ef80e', 'request_id': 'req-db201581-3e33-48f9-91ae-feff2bbfb486'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.387414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18e66056ea94f8a8d1d6643b33ef80e', 'request_id': 'req-db201581-3e33-48f9-91ae-feff2bbfb486'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.394748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18e66056ea94f8a8d1d6643b33ef80e', 'request_id': 'req-db201581-3e33-48f9-91ae-feff2bbfb486'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.407153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] The token cache is being invalidate because project c18e66056ea94f8a8d1d6643b33ef80e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:16.407757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.409136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.410695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1208/2431] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:16 2022] DELETE /identity/v3/projects/c18e66056ea94f8a8d1d6643b33ef80e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:16.415267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:16.428346 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acb8f2-345f-413a-b6c4-35190eb4045a service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:16.491797 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:16.493803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:16.494091 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:16.494369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] PATH_INFO: `/v3/users/7ab0013572934fb38f3d65f15a842fcb` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:16.495700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab0013572934fb38f3d65f15a842fcb)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:16.497643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:16.703946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab0013572934fb38f3d65f15a842fcb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.704656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab0013572934fb38f3d65f15a842fcb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.718394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab0013572934fb38f3d65f15a842fcb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.725645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab0013572934fb38f3d65f15a842fcb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.844325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-67e74934-596b-43ac-bffb-4f2eff803190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab0013572934fb38f3d65f15a842fcb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:16.853123 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1224/2432] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:16 2022] DELETE /identity/v3/users/7ab0013572934fb38f3d65f15a842fcb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:17.338910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:17.339486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:17.352122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db201581-3e33-48f9-91ae-feff2bbfb486 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:17.410095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:17.410980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:17.411264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:17.411539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] PATH_INFO: `/v3/projects/280d67ff9a51470e881bc4bd9e9b0f38` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:17.412719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=280d67ff9a51470e881bc4bd9e9b0f38)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:17.414604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:17.550714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280d67ff9a51470e881bc4bd9e9b0f38', 'request_id': 'req-bc75749d-bb03-4a33-baba-fc68e81dc0ea'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:17.634222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280d67ff9a51470e881bc4bd9e9b0f38', 'request_id': 'req-bc75749d-bb03-4a33-baba-fc68e81dc0ea'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:17.644080 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280d67ff9a51470e881bc4bd9e9b0f38', 'request_id': 'req-bc75749d-bb03-4a33-baba-fc68e81dc0ea'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:17.658592 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] The token cache is being invalidate because project 280d67ff9a51470e881bc4bd9e9b0f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:17.659050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:17.659770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bc75749d-bb03-4a33-baba-fc68e81dc0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:17.661673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1209/2433] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:17 2022] DELETE /identity/v3/projects/280d67ff9a51470e881bc4bd9e9b0f38 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:17.667445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8b25-23fe-4098-9487-49d192106d15 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:17.667924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8b25-23fe-4098-9487-49d192106d15 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:17.668017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8b25-23fe-4098-9487-49d192106d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:17.687450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c12c8b25-23fe-4098-9487-49d192106d15 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:17.688697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c12c8b25-23fe-4098-9487-49d192106d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:17.751282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1225/2434] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:17.760076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f69137-ea3d-4c42-a128-774490614deb None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:17.760450 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f69137-ea3d-4c42-a128-774490614deb None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:17.760857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f69137-ea3d-4c42-a128-774490614deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:17.788425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-29f69137-ea3d-4c42-a128-774490614deb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:17.789706 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-29f69137-ea3d-4c42-a128-774490614deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:17.799964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1210/2435] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:17.806025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8b25-23fe-4098-9487-49d192106d15 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:17.815749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8b25-23fe-4098-9487-49d192106d15 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:17.820397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:17.821667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:17.822105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:17.822238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:17.823096 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:17.823394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:17.824966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:17.839698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1226/2436] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:17.840810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f69137-ea3d-4c42-a128-774490614deb None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:17.850205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f69137-ea3d-4c42-a128-774490614deb None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:17.855058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:17.855697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:17.855981 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:17.856257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:17.856959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:17.858889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:17.978586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1211/2437] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:17 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:17.982706 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:17.993685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aae85c-97fb-4318-a8c5-fce5803b67a8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.057795 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.058467 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.058748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.059063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.059786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.061812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.147347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1227/2438] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:17 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:18.152004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.162127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668208e3-5ad1-49cf-8729-cae7901a815a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.167250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.167896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.168182 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.168457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.169185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.170762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.182280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1212/2439] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:18.186053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.196515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c8dbb-fc14-485b-a7fa-eb92aa2fe9ac admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.201625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dea7b-7253-403d-9c11-f6903c3c8b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.203986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dea7b-7253-403d-9c11-f6903c3c8b4c admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.203986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dea7b-7253-403d-9c11-f6903c3c8b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.203986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dea7b-7253-403d-9c11-f6903c3c8b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.203986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dea7b-7253-403d-9c11-f6903c3c8b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.205135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dea7b-7253-403d-9c11-f6903c3c8b4c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.215812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1228/2440] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:18.221472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.231452 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64098529-96b0-4964-b41a-42a8a5a88cae admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.236101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.237001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.237293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.237546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] PATH_INFO: `/v3/projects/db707e3ee36547f69479da358da2d53a/users/64e3fccd3f334fa18388f91ded5d2036/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.251538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db707e3ee36547f69479da358da2d53a, user_id=64e3fccd3f334fa18388f91ded5d2036, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.254425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.353375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1213/2441] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:18 2022] PUT /identity/v3/projects/db707e3ee36547f69479da358da2d53a/users/64e3fccd3f334fa18388f91ded5d2036/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:18.363551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514fcea-6d1b-4fdd-8f25-6811fe320d49 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.363842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514fcea-6d1b-4fdd-8f25-6811fe320d49 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.364120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514fcea-6d1b-4fdd-8f25-6811fe320d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.391778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e514fcea-6d1b-4fdd-8f25-6811fe320d49 None None] MFA Rules not processed for user `64e3fccd3f334fa18388f91ded5d2036`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:18.392985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e514fcea-6d1b-4fdd-8f25-6811fe320d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:18.455880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1229/2442] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:18.460324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.520156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc70b-ffd6-4968-b670-40870cf53860 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.524960 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.525595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.525873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.526142 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.526875 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.528830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.628936 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1214/2443] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:18 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:18.633294 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514fcea-6d1b-4fdd-8f25-6811fe320d49 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.644818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514fcea-6d1b-4fdd-8f25-6811fe320d49 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.701712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.702375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.702631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.702935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.703641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.705546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.804332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1230/2444] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:18 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:18.809340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.819331 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbb91-0559-4477-8db2-dd561dc27054 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.824474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.825116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.825396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.825941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.826701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.828400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.839316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1215/2445] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:18.843213 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.854058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9870625-8adc-46fc-b4b5-93a303df9e43 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.858925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7371e-4d2e-404c-b8c1-c956d3aace63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.859673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7371e-4d2e-404c-b8c1-c956d3aace63 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.859954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7371e-4d2e-404c-b8c1-c956d3aace63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.860226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7371e-4d2e-404c-b8c1-c956d3aace63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.860997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7371e-4d2e-404c-b8c1-c956d3aace63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.862561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7371e-4d2e-404c-b8c1-c956d3aace63 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.876484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1231/2446] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:18.877891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:18.887921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339a73b-c655-4e59-87f2-2cc1c02e1c49 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:18.892572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:18.893437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:18.895291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:18.895291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] PATH_INFO: `/v3/projects/cffd6e2c06934be3a1ca67b3fc58b249/users/109f96bf6e4d4a17a803134001b81e7a/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:18.908553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffd6e2c06934be3a1ca67b3fc58b249, user_id=109f96bf6e4d4a17a803134001b81e7a, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:18.911278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:18.989273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1216/2447] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:18 2022] PUT /identity/v3/projects/cffd6e2c06934be3a1ca67b3fc58b249/users/109f96bf6e4d4a17a803134001b81e7a/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:19.000687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4727e-e7f2-4768-8ef2-48f49325e30f None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.001154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4727e-e7f2-4768-8ef2-48f49325e30f None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.001503 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4727e-e7f2-4768-8ef2-48f49325e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.029465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-5ff4727e-e7f2-4768-8ef2-48f49325e30f None None] MFA Rules not processed for user `109f96bf6e4d4a17a803134001b81e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:19.030651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5ff4727e-e7f2-4768-8ef2-48f49325e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.115816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1232/2448] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:19.116923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.189094 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b7ed-b83c-410d-8b6a-6291e97bf66f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.203770 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584400ae-56c3-4e7c-95d6-64ff6a606ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.208859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584400ae-56c3-4e7c-95d6-64ff6a606ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.208859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584400ae-56c3-4e7c-95d6-64ff6a606ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.208859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584400ae-56c3-4e7c-95d6-64ff6a606ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.208859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584400ae-56c3-4e7c-95d6-64ff6a606ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.208859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584400ae-56c3-4e7c-95d6-64ff6a606ff3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.315257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1217/2449] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:19 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:19.319334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4727e-e7f2-4768-8ef2-48f49325e30f None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.330961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4727e-e7f2-4768-8ef2-48f49325e30f None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.346926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93039-d6cd-48c5-821f-5d393d9eaa20 None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.346926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93039-d6cd-48c5-821f-5d393d9eaa20 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.346926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93039-d6cd-48c5-821f-5d393d9eaa20 None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.363239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1218/2450] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:50:19 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:50:19.366951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.367404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.368909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.409754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.416950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.416950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.416950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.416950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.416950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.417411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] MFA Rules not processed for user `bf69b08068054c4180f2d44c9c07cb60`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:19.417411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.482544 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1219/2451] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:19.495481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.496843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.521596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1233/2452] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:19 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:19.522699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.532893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852f886-675e-47dc-82b1-c1b61721efa2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.538032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.538666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.538997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.539265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.540710 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.542411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.556581 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1234/2453] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:19.557047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.566562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216be90-669b-4228-a276-bc09ad001ad5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.571782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.572662 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.572943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.573219 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] PATH_INFO: `/v3/projects/25807cb699d843979e6b5732c85fe3b2/users/06b93fb0026a43f38508a6607a6b60d4/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.577260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6b506-eca1-498e-bdff-aa8049cc893b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.581067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72317f5c187c41e9b2d1c53c9cedcd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.581708 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.581990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.582265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.587875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25807cb699d843979e6b5732c85fe3b2, user_id=06b93fb0026a43f38508a6607a6b60d4, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.590566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.593047 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.594467 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.606108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1220/2454] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:19.655918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1235/2455] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:19 2022] PUT /identity/v3/projects/25807cb699d843979e6b5732c85fe3b2/users/06b93fb0026a43f38508a6607a6b60d4/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:19.659911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.670130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5fe93-9b30-43e7-9b56-c1a02b733aa3 service glance] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.728178 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.728836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.729116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.729453 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.730185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.731808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.742001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1221/2456] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:19.745134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.745675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.746989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.756078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa97f-d790-4c54-82d7-e4724b411816 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.761514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b46ef-a869-468d-a299-fcffb37e6737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.762393 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b46ef-a869-468d-a299-fcffb37e6737 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.762717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b46ef-a869-468d-a299-fcffb37e6737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.763024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b46ef-a869-468d-a299-fcffb37e6737 admin admin] PATH_INFO: `/v3/projects/25807cb699d843979e6b5732c85fe3b2/users/06b93fb0026a43f38508a6607a6b60d4/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.764971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b46ef-a869-468d-a299-fcffb37e6737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25807cb699d843979e6b5732c85fe3b2, user_id=06b93fb0026a43f38508a6607a6b60d4, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.767624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b46ef-a869-468d-a299-fcffb37e6737 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.779508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1222/2457] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:19 2022] PUT /identity/v3/projects/25807cb699d843979e6b5732c85fe3b2/users/06b93fb0026a43f38508a6607a6b60d4/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:19.789603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49924d-ce3c-479f-a6c2-cfaafabcc191 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.789977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49924d-ce3c-479f-a6c2-cfaafabcc191 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.790324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49924d-ce3c-479f-a6c2-cfaafabcc191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.806249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7819dd-b1d4-4c67-8f5a-598063f148b0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.819375 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-fc49924d-ce3c-479f-a6c2-cfaafabcc191 None None] MFA Rules not processed for user `06b93fb0026a43f38508a6607a6b60d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:19.820610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fc49924d-ce3c-479f-a6c2-cfaafabcc191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.857012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.857656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.857939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.858212 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.860029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.889298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1223/2458] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:19.890617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c663-1610-4788-8a83-ae2cdc36d95d None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.890945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c663-1610-4788-8a83-ae2cdc36d95d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.891219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c663-1610-4788-8a83-ae2cdc36d95d None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.892984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1224/2459] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:50:19.899771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.899771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.900184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.918551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] MFA Rules not processed for user `889a6422677047b6a75d1480f156ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:19.919781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.925957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.927442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.937564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1236/2460] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:19.938368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.939719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:19.950671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a228b-355a-415b-b5a5-ce3b8fd6aaed service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:19.954515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:19.955188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:19.955473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:19.955754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:19.964894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:19.966315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:19.974628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1225/2461] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:19.975914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1237/2462] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:19.986615 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:19.989053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:20.000654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f8521-f42d-45b3-9b29-17c839b0b57a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:20.004730 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:20.005406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:20.005723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:20.006054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:20.014264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:20.017157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:20.023741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1226/2463] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:20.143916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:20.153215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e37c-a657-46a7-97c9-8e111629f75e service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:20.157179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de028f69-b458-4944-a827-fe136d8250c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:20.157834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de028f69-b458-4944-a827-fe136d8250c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:20.158136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de028f69-b458-4944-a827-fe136d8250c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:20.158376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de028f69-b458-4944-a827-fe136d8250c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:20.217353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de028f69-b458-4944-a827-fe136d8250c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:20.223607 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de028f69-b458-4944-a827-fe136d8250c2 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:20.233517 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1238/2464] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:20.752573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:20.758634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:20.819927 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288e99d-2735-43af-9b2a-04a004a6a6e6 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:20.825099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:20.825956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:20.826230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:20.826498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] PATH_INFO: `/v3/users/6f9cef0d94d94d27bf2ef9b0263acae9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:20.827737 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9cef0d94d94d27bf2ef9b0263acae9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:20.829670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:21.057531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9cef0d94d94d27bf2ef9b0263acae9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.129655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9cef0d94d94d27bf2ef9b0263acae9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.130317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9cef0d94d94d27bf2ef9b0263acae9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.130953 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9cef0d94d94d27bf2ef9b0263acae9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.138567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9cef0d94d94d27bf2ef9b0263acae9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.163356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1227/2465] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:20 2022] DELETE /identity/v3/users/6f9cef0d94d94d27bf2ef9b0263acae9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:21.165070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:21.166082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:21.166352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:21.186727 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:21.188315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:21.254378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1239/2466] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:21.266415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:21.266415 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:21.321602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de357713-315f-42e3-b1a3-98e7ae4a0166 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:21.325284 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265192c-231d-4e30-8b56-94f1dacbedf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:21.325913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265192c-231d-4e30-8b56-94f1dacbedf7 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:21.326197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265192c-231d-4e30-8b56-94f1dacbedf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:21.326475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265192c-231d-4e30-8b56-94f1dacbedf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:21.335433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265192c-231d-4e30-8b56-94f1dacbedf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:21.336862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265192c-231d-4e30-8b56-94f1dacbedf7 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:21.346723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1228/2467] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:21.800689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:21.803629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:21.819993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67aee5-0b39-4352-92a6-8c29fc22bb1a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:21.828353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:21.829634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:21.830103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:21.830528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] PATH_INFO: `/v3/projects/584202b5b2364b31a0c0b9214bbe5007` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:21.832129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=584202b5b2364b31a0c0b9214bbe5007)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:21.834166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:21.917664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584202b5b2364b31a0c0b9214bbe5007', 'request_id': 'req-1fa792db-2258-4735-9711-1d382e395f4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.923029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584202b5b2364b31a0c0b9214bbe5007', 'request_id': 'req-1fa792db-2258-4735-9711-1d382e395f4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.975561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584202b5b2364b31a0c0b9214bbe5007', 'request_id': 'req-1fa792db-2258-4735-9711-1d382e395f4e'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.987434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] The token cache is being invalidate because project 584202b5b2364b31a0c0b9214bbe5007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:21.987716 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.988335 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1fa792db-2258-4735-9711-1d382e395f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:21.989852 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1240/2468] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:21 2022] DELETE /identity/v3/projects/584202b5b2364b31a0c0b9214bbe5007 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:21.996552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0aaa97-a682-41a6-b895-f6b490b139d9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:21.997048 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0aaa97-a682-41a6-b895-f6b490b139d9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:21.997206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0aaa97-a682-41a6-b895-f6b490b139d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.015523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-0f0aaa97-a682-41a6-b895-f6b490b139d9 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:22.016702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0f0aaa97-a682-41a6-b895-f6b490b139d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:22.073756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1229/2469] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:22.083095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900087-db3a-4383-88fc-5c1b26ef9b0e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.083095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900087-db3a-4383-88fc-5c1b26ef9b0e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.083095 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900087-db3a-4383-88fc-5c1b26ef9b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.106371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-18900087-db3a-4383-88fc-5c1b26ef9b0e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:22.107615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-18900087-db3a-4383-88fc-5c1b26ef9b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:22.115605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1241/2470] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:22.126548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0aaa97-a682-41a6-b895-f6b490b139d9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.129538 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0aaa97-a682-41a6-b895-f6b490b139d9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.133992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.134673 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.135468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.135744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.136493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:22.136791 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.138356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:22.149552 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1230/2471] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:22.154122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900087-db3a-4383-88fc-5c1b26ef9b0e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.163279 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900087-db3a-4383-88fc-5c1b26ef9b0e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.168728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.169363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.169641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.169912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.170624 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.172533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:22.253315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1242/2472] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:22 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:22.259222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.269355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eddaa3-e698-4420-9bf6-40b049b2a078 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.324148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.324728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.325034 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.325309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.326010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.328018 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:22.404457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1231/2473] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:22 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:22.408531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.419414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa4595-c95d-48d2-b8cf-f2e3da97c898 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.424029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.424672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.424955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.425230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.425962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.427597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:22.437974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1243/2474] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:22.441797 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.451534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7be08-33c1-49c8-b33e-86030c195d64 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.456040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7e120-0b9b-4662-839e-f99038e56691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.456678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7e120-0b9b-4662-839e-f99038e56691 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.457253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7e120-0b9b-4662-839e-f99038e56691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.457532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7e120-0b9b-4662-839e-f99038e56691 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.458248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7e120-0b9b-4662-839e-f99038e56691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.459859 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7e120-0b9b-4662-839e-f99038e56691 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:22.470135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1232/2475] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:22.474087 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.484792 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579372f5-aba1-425e-b294-80171b4f4de5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.489745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.490670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.490989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.491263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] PATH_INFO: `/v3/projects/c4a23cdd260746fc8f294568fee2c4ce/users/8ff65d851b55475d91491865a5b9b09f/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.506385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a23cdd260746fc8f294568fee2c4ce, user_id=8ff65d851b55475d91491865a5b9b09f, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.509085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:22.593337 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1244/2476] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:22 2022] PUT /identity/v3/projects/c4a23cdd260746fc8f294568fee2c4ce/users/8ff65d851b55475d91491865a5b9b09f/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:22.604335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528bd8d-4094-4a19-a2a7-148edd1dfae9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.604620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528bd8d-4094-4a19-a2a7-148edd1dfae9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.604896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528bd8d-4094-4a19-a2a7-148edd1dfae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.630772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-a528bd8d-4094-4a19-a2a7-148edd1dfae9 None None] MFA Rules not processed for user `8ff65d851b55475d91491865a5b9b09f`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:22.631984 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a528bd8d-4094-4a19-a2a7-148edd1dfae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:22.693672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1233/2477] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:22.704307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.706112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:22.763960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f02618-e8dc-4fe1-8645-fac176f6e968 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.767825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31a27b-4ef5-4b53-bf88-10755fd6fd56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.768459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a27b-4ef5-4b53-bf88-10755fd6fd56 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.768739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a27b-4ef5-4b53-bf88-10755fd6fd56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.769005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a27b-4ef5-4b53-bf88-10755fd6fd56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.778477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31a27b-4ef5-4b53-bf88-10755fd6fd56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.780031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31a27b-4ef5-4b53-bf88-10755fd6fd56 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:22.789966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1245/2478] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:22.827187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528bd8d-4094-4a19-a2a7-148edd1dfae9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:22.898262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528bd8d-4094-4a19-a2a7-148edd1dfae9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:22.904381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:22.904819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:22.905160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:22.905498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] PATH_INFO: `/v3/users/8ff65d851b55475d91491865a5b9b09f` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:22.906850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff65d851b55475d91491865a5b9b09f)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:22.908941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:23.081697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff65d851b55475d91491865a5b9b09f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:23.141490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff65d851b55475d91491865a5b9b09f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:23.142167 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff65d851b55475d91491865a5b9b09f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:23.142778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff65d851b55475d91491865a5b9b09f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:23.152571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff65d851b55475d91491865a5b9b09f'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:23.169886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1234/2479] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:22 2022] DELETE /identity/v3/users/8ff65d851b55475d91491865a5b9b09f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:23.174490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:23.174987 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:23.175134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:23.192620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:23.194027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:23.253664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1246/2480] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:23.265438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:23.266896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:23.327053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3772b5-ca1a-421b-9bec-88a58162c239 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:23.330740 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:23.331438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:23.331718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:23.331993 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:23.342262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:23.343712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:23.353794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1235/2481] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:23.736523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:23.737984 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:23.754738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfe52c-e9db-4572-bfa6-f3727c91ec39 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:23.762057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:23.763347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:23.763621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:23.764207 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] PATH_INFO: `/v3/projects/c4a23cdd260746fc8f294568fee2c4ce` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:23.765447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a23cdd260746fc8f294568fee2c4ce)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:23.767424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:23.867401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:23.869346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:23.881384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c77a1-5765-440d-be44-e67676c445e9 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:23.885712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:23.886340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:23.887215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:23.887215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:23.888829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:23.897050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a23cdd260746fc8f294568fee2c4ce', 'request_id': 'req-4cf00784-ad38-49a8-9050-d4c83cc77273'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:23.902400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a23cdd260746fc8f294568fee2c4ce', 'request_id': 'req-4cf00784-ad38-49a8-9050-d4c83cc77273'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:23.958705 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:23.960204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:23.971198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1236/2482] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:24.021290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a23cdd260746fc8f294568fee2c4ce', 'request_id': 'req-4cf00784-ad38-49a8-9050-d4c83cc77273'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:24.027076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:24.034642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] The token cache is being invalidate because project c4a23cdd260746fc8f294568fee2c4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:24.035813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:24.036186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcba3c4-bc44-4738-8500-e184600556ad service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:24.036719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:24.038820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1247/2483] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:23 2022] DELETE /identity/v3/projects/c4a23cdd260746fc8f294568fee2c4ce => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:24.102316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a9278-1539-44d2-9c54-7cb43b3829b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:24.103748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9278-1539-44d2-9c54-7cb43b3829b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:24.103903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9278-1539-44d2-9c54-7cb43b3829b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:24.104181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9278-1539-44d2-9c54-7cb43b3829b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:24.106433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-686a9278-1539-44d2-9c54-7cb43b3829b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:24.188288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a9278-1539-44d2-9c54-7cb43b3829b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:24.189665 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a9278-1539-44d2-9c54-7cb43b3829b9 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:24.202267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1237/2484] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:26.715821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:26.717389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:26.786464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:26.787038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:26.787153 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:26.788226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf00784-ad38-49a8-9050-d4c83cc77273 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:26.793309 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:26.794169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:26.794501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:26.794749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] PATH_INFO: `/v3/users/64e3fccd3f334fa18388f91ded5d2036` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:26.799567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e3fccd3f334fa18388f91ded5d2036)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:26.802965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:26.805833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:26.808164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:26.865384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1238/2485] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:26.878523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:26.879935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:26.947950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c36e8a-9b20-4b61-b96f-2dce83503d63 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:26.953435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:26.954058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:26.954339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:26.954610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:26.959942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e3fccd3f334fa18388f91ded5d2036'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:26.960655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e3fccd3f334fa18388f91ded5d2036'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:26.964846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:26.967051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:26.974902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e3fccd3f334fa18388f91ded5d2036'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:26.977009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1239/2486] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:50:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:50:26.984675 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e3fccd3f334fa18388f91ded5d2036'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:27.046586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:27.048024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:27.061659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e224c-683c-4337-b635-7daa5119d9c8 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:27.066365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:27.066989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6d0ab9c1-0022-490d-ab2f-6848f2867bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e3fccd3f334fa18388f91ded5d2036'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:27.067293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:27.067581 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:27.067877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] PATH_INFO: `/v3/users/a06027a8c2494d95879d6a1e7acc229c` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:27.069398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06027a8c2494d95879d6a1e7acc229c)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:27.071092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:27.073892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1248/2487] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:26 2022] DELETE /identity/v3/users/64e3fccd3f334fa18388f91ded5d2036 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:27.078899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:27.081875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:27.081875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:27.100092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:27.101690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:27.186989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1249/2488] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:27.199117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:27.202590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:27.282144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06027a8c2494d95879d6a1e7acc229c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:27.282697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2242f-2a88-4a9f-b97a-2fa1b519867b None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:27.288736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9190d3-ea98-47ef-8985-f75d32baeb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:27.289397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9190d3-ea98-47ef-8985-f75d32baeb6a service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:27.289715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9190d3-ea98-47ef-8985-f75d32baeb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:27.289996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9190d3-ea98-47ef-8985-f75d32baeb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:27.301354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9190d3-ea98-47ef-8985-f75d32baeb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:27.303231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9190d3-ea98-47ef-8985-f75d32baeb6a service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:27.315369 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1250/2489] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:27.370662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06027a8c2494d95879d6a1e7acc229c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:27.371231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06027a8c2494d95879d6a1e7acc229c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:27.371845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06027a8c2494d95879d6a1e7acc229c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:27.380759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06027a8c2494d95879d6a1e7acc229c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:27.415140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1240/2490] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:27 2022] DELETE /identity/v3/users/a06027a8c2494d95879d6a1e7acc229c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:27.419953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:27.420583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:27.420583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:27.448353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:27.449843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:27.534599 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1251/2491] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:27.545759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:27.547258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:27.640302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade15b43-12ac-492f-a984-d1755df033be admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:27.644303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:27.644951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:27.645230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:27.645496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:27.674356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:27.676994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:27.692572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1241/2492] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:27.928053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:27.930202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:27.953688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a2416-60b5-435c-b09e-81bec8f1917a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:27.981242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:27.982462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:27.982744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:27.983045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] PATH_INFO: `/v3/projects/db707e3ee36547f69479da358da2d53a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:27.985566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db707e3ee36547f69479da358da2d53a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:27.987514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:28.177718 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db707e3ee36547f69479da358da2d53a', 'request_id': 'req-18a2b183-c2c3-4210-8859-52cea78aa874'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.194739 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db707e3ee36547f69479da358da2d53a', 'request_id': 'req-18a2b183-c2c3-4210-8859-52cea78aa874'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.261513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db707e3ee36547f69479da358da2d53a', 'request_id': 'req-18a2b183-c2c3-4210-8859-52cea78aa874'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.273781 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] The token cache is being invalidate because project db707e3ee36547f69479da358da2d53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:28.274063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.274882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.277298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1252/2493] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:27 2022] DELETE /identity/v3/projects/db707e3ee36547f69479da358da2d53a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:28.281067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:28.291476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285d4d-8097-460e-a3bc-9a13f2022015 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:28.331655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:28.333168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:28.391330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:28.392531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:28.392819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:28.393101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] PATH_INFO: `/v3/users/109f96bf6e4d4a17a803134001b81e7a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:28.395352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] RBAC: Authorizing `identity:delete_user(user_id=109f96bf6e4d4a17a803134001b81e7a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:28.402597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:28.468068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b183-c2c3-4210-8859-52cea78aa874 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:28.473097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:28.474210 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:28.474602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:28.475009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] PATH_INFO: `/v3/projects/95e6b6243fa04323abfd692418dcbd7a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:28.476356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e6b6243fa04323abfd692418dcbd7a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:28.479358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:28.578550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109f96bf6e4d4a17a803134001b81e7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.596990 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e6b6243fa04323abfd692418dcbd7a', 'request_id': 'req-121a59d4-9c01-4497-8640-b03777040f3a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.602938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e6b6243fa04323abfd692418dcbd7a', 'request_id': 'req-121a59d4-9c01-4497-8640-b03777040f3a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.650879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109f96bf6e4d4a17a803134001b81e7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.651733 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109f96bf6e4d4a17a803134001b81e7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.652518 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109f96bf6e4d4a17a803134001b81e7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.661454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109f96bf6e4d4a17a803134001b81e7a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.680146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1242/2494] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:28 2022] DELETE /identity/v3/users/109f96bf6e4d4a17a803134001b81e7a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:28.707167 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e6b6243fa04323abfd692418dcbd7a', 'request_id': 'req-121a59d4-9c01-4497-8640-b03777040f3a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.723039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] The token cache is being invalidate because project 95e6b6243fa04323abfd692418dcbd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:28.723636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.724411 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:28.730625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:28.732703 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:28.732916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1253/2495] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:28 2022] DELETE /identity/v3/projects/95e6b6243fa04323abfd692418dcbd7a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:28.821216 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629db97-9ccc-4ebf-9815-659da105883f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:28.827314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:28.828498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:28.828926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:28.829249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] PATH_INFO: `/v3/users/cb477b141a2140cca076fedaa0c9e183` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:28.831692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb477b141a2140cca076fedaa0c9e183)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:28.834400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:29.019833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb477b141a2140cca076fedaa0c9e183'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.101078 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb477b141a2140cca076fedaa0c9e183'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.101858 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb477b141a2140cca076fedaa0c9e183'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.102499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb477b141a2140cca076fedaa0c9e183'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.112305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb477b141a2140cca076fedaa0c9e183'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.139422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:29.142194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:29.142825 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1243/2496] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:28 2022] DELETE /identity/v3/users/cb477b141a2140cca076fedaa0c9e183 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:29.258006 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a59d4-9c01-4497-8640-b03777040f3a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:29.349899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:29.350686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:29.351013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:29.351360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] PATH_INFO: `/v3/projects/cffd6e2c06934be3a1ca67b3fc58b249` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:29.352570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffd6e2c06934be3a1ca67b3fc58b249)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:29.355196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:29.478824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffd6e2c06934be3a1ca67b3fc58b249', 'request_id': 'req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.490953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffd6e2c06934be3a1ca67b3fc58b249', 'request_id': 'req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.542014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffd6e2c06934be3a1ca67b3fc58b249', 'request_id': 'req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.557051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] The token cache is being invalidate because project cffd6e2c06934be3a1ca67b3fc58b249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:29.557621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.558429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:29.560430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1254/2497] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:29 2022] DELETE /identity/v3/projects/cffd6e2c06934be3a1ca67b3fc58b249 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:29.564124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:29.566184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:29.580568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c29fd-a8ea-49df-8c61-b9391ecbfddb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:29.637846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:29.639030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:29.639381 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:29.639722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] PATH_INFO: `/v3/users/06b93fb0026a43f38508a6607a6b60d4` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:29.641008 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b93fb0026a43f38508a6607a6b60d4)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:29.643107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:29.653037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:29.655405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:29.671656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ea62-7702-4c57-ac28-97b99e82d7f8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:29.678711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:29.679796 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:29.680077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:29.680466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] PATH_INFO: `/v3/projects/05901fc64f0641d0935426356311dd87` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:29.682756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05901fc64f0641d0935426356311dd87)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:29.688064 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:30.431991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b93fb0026a43f38508a6607a6b60d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.433030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05901fc64f0641d0935426356311dd87', 'request_id': 'req-1388d656-3990-48de-b706-772f7bd12dd9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.451585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05901fc64f0641d0935426356311dd87', 'request_id': 'req-1388d656-3990-48de-b706-772f7bd12dd9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.542241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b93fb0026a43f38508a6607a6b60d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.542926 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b93fb0026a43f38508a6607a6b60d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.543604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b93fb0026a43f38508a6607a6b60d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.551261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-533459bb-6784-4827-aaff-344dafd45531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b93fb0026a43f38508a6607a6b60d4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.570267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1244/2498] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:29 2022] DELETE /identity/v3/users/06b93fb0026a43f38508a6607a6b60d4 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:30.598442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05901fc64f0641d0935426356311dd87', 'request_id': 'req-1388d656-3990-48de-b706-772f7bd12dd9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.610976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] The token cache is being invalidate because project 05901fc64f0641d0935426356311dd87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:30.612596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.612596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1388d656-3990-48de-b706-772f7bd12dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:30.619813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1255/2499] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:29 2022] DELETE /identity/v3/projects/05901fc64f0641d0935426356311dd87 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:30.621610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e85481-8e30-4573-9459-bcf5c6080083 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:30.621942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e85481-8e30-4573-9459-bcf5c6080083 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:30.622485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e85481-8e30-4573-9459-bcf5c6080083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:30.647540 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-06e85481-8e30-4573-9459-bcf5c6080083 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:30.648760 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-06e85481-8e30-4573-9459-bcf5c6080083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:30.721318 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1245/2500] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:30.732534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b66c-dbb7-4f76-a17a-70ec056ad1a0 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:30.732823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b66c-dbb7-4f76-a17a-70ec056ad1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:30.733099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b66c-dbb7-4f76-a17a-70ec056ad1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:30.752799 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-80d6b66c-dbb7-4f76-a17a-70ec056ad1a0 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:30.756275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-80d6b66c-dbb7-4f76-a17a-70ec056ad1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:30.768516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1256/2501] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:30.773099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e85481-8e30-4573-9459-bcf5c6080083 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:30.783914 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e85481-8e30-4573-9459-bcf5c6080083 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:30.788779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:30.790844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:30.790844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:30.790844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:30.791487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:30.791686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:30.793481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:30.819130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1246/2502] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:30.820769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6b66c-dbb7-4f76-a17a-70ec056ad1a0 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:30.834887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6b66c-dbb7-4f76-a17a-70ec056ad1a0 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:30.840728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726353-499f-4402-994f-402984bf047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:30.841386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726353-499f-4402-994f-402984bf047e admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:30.841665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726353-499f-4402-994f-402984bf047e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:30.841935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726353-499f-4402-994f-402984bf047e admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:30.842652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60726353-499f-4402-994f-402984bf047e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:30.844660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60726353-499f-4402-994f-402984bf047e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:30.937978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1257/2503] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:30 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:30.942202 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:30.957691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eadb24-1746-4866-b732-c7832a69b196 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.018649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.019406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.019694 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.019968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.020680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.022693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.036196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726353-499f-4402-994f-402984bf047e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.053798 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-60726353-499f-4402-994f-402984bf047e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:31.068500 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726353-499f-4402-994f-402984bf047e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.074912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.075603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.076051 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.076498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] PATH_INFO: `/v3/projects/25807cb699d843979e6b5732c85fe3b2` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.077988 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25807cb699d843979e6b5732c85fe3b2)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.080033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.098449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1247/2504] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:30 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:31.103180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.113403 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51857f-821b-4e4f-9a76-1644e15f3951 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.119276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.120152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.120502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.120919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.121801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.123829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.137568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1248/2505] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:31.141551 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.152376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aea27-601d-43d3-9d08-34db5d61e3bf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.157232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.157920 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.158207 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.158483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.159291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.162514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.174752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1249/2506] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:31.178778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.195121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b420e9-f41c-43fa-be7e-548c6fb2604e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.206052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25807cb699d843979e6b5732c85fe3b2', 'request_id': 'req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:31.214431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25807cb699d843979e6b5732c85fe3b2', 'request_id': 'req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:31.259788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbfd44-5c46-4b9f-b8ba-b7c3e7ee6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.260685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbfd44-5c46-4b9f-b8ba-b7c3e7ee6cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.260961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbfd44-5c46-4b9f-b8ba-b7c3e7ee6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.261262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbfd44-5c46-4b9f-b8ba-b7c3e7ee6cd4 admin admin] PATH_INFO: `/v3/projects/a457f04822fb49349ae3331399afabbb/users/ca3c4e72548a44349980fc71071f72d8/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.280979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbfd44-5c46-4b9f-b8ba-b7c3e7ee6cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a457f04822fb49349ae3331399afabbb, user_id=ca3c4e72548a44349980fc71071f72d8, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.284439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbfd44-5c46-4b9f-b8ba-b7c3e7ee6cd4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.295461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25807cb699d843979e6b5732c85fe3b2', 'request_id': 'req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:31.311157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] The token cache is being invalidate because project 25807cb699d843979e6b5732c85fe3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:31.311452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:31.312157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f87a772e-cd51-4469-9f7b-39b2a1a6aa22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:31.314348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1258/2507] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:31 2022] DELETE /identity/v3/projects/25807cb699d843979e6b5732c85fe3b2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:31.320914 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad5135-5ae3-4127-8ede-d65b3dbb062c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.323269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad5135-5ae3-4127-8ede-d65b3dbb062c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.323269 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad5135-5ae3-4127-8ede-d65b3dbb062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.345090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-4dad5135-5ae3-4127-8ede-d65b3dbb062c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:31.345090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-4dad5135-5ae3-4127-8ede-d65b3dbb062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:31.351097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1259/2508] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:31.359806 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5ccc-e526-4066-91bc-0dcbcbaaee85 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.360083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5ccc-e526-4066-91bc-0dcbcbaaee85 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.360353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5ccc-e526-4066-91bc-0dcbcbaaee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.380299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3a5d5ccc-e526-4066-91bc-0dcbcbaaee85 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:31.381566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3a5d5ccc-e526-4066-91bc-0dcbcbaaee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:31.398781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1250/2509] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:31 2022] PUT /identity/v3/projects/a457f04822fb49349ae3331399afabbb/users/ca3c4e72548a44349980fc71071f72d8/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:31.401165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.401622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.402594 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.437762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] MFA Rules not processed for user `ca3c4e72548a44349980fc71071f72d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:31.439117 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:31.448414 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1260/2510] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:50:31.452574 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d5ccc-e526-4066-91bc-0dcbcbaaee85 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.461882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d5ccc-e526-4066-91bc-0dcbcbaaee85 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.467055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.467708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.468031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.468625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.469361 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:31.469661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.471290 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.484622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1261/2511] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:31.490304 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.502347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd31062-f4a2-4a7a-8e0f-531a1856d008 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.511876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.513134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.514293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.514742 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.515687 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.517769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.523575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1251/2512] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:31.528486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.529868 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:31.553950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84689c8-4a38-4562-a165-9d9a79297a56 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.559517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.560340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.560621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.560886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.561589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.563595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.616954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1262/2513] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:31 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:31.621708 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.675773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1252/2514] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:31 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:50:31.679709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.723567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dda71-c532-4056-ae25-6456afc3f2f7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.784599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b994b-c707-41d9-87eb-2571b2b2ef78 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.789492 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.791023 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.791372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.791709 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.792624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.794664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.810024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.810779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.811093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.811363 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.812059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.814183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.902439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1253/2515] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:31 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:31.907494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.908866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1263/2516] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:31 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:31.912665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.921240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c35a7-bd79-4888-b027-a0f89eb4923b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.923978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb520-0f58-4ca1-a59e-e26c28c90553 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.926277 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.927128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.932781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.932781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.932781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.933068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.933068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.933259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.933343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.933343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.933343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.933811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.941647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1254/2517] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:31.945579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.948605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1264/2518] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:31.952757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:31.959157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ad1c9-af2a-453d-99ce-e2e29d998d48 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.968696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.969322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.969600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.969869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] PATH_INFO: `/v3/projects/8b3d59b1dbf14c70b717cb5f6ca37327/users/78d9c4cf74614359833be001d7d8dfef/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.974263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac38d9b-939d-48ed-83ca-255bed85a1b3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:31.986938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3d59b1dbf14c70b717cb5f6ca37327, user_id=78d9c4cf74614359833be001d7d8dfef, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.988532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:31.989277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:31.989653 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:31.989996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:31.990122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:31.990895 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:31.992570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:32.003704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1265/2519] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:32.007744 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:32.017544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b435e4-1950-484a-8d22-a0951a29cccc admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:32.022388 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6ed7-8358-46e3-b743-6936dd5c0313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:32.023292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6ed7-8358-46e3-b743-6936dd5c0313 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.023571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6ed7-8358-46e3-b743-6936dd5c0313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.023842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6ed7-8358-46e3-b743-6936dd5c0313 admin admin] PATH_INFO: `/v3/projects/567655407db74e1480c9cd5671145ccc/users/05e62d87775841e8af0b49f05c6d5fda/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.041093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b6ed7-8358-46e3-b743-6936dd5c0313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567655407db74e1480c9cd5671145ccc, user_id=05e62d87775841e8af0b49f05c6d5fda, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:32.043912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b6ed7-8358-46e3-b743-6936dd5c0313 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:32.055486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1255/2520] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:31 2022] PUT /identity/v3/projects/8b3d59b1dbf14c70b717cb5f6ca37327/users/78d9c4cf74614359833be001d7d8dfef/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:32.060333 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:32.157566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12284-d497-46ea-a551-48e4f5ec3b5e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:32.157566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:32.157566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.157566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.158039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.158039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:32.158039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:32.158039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1256/2521] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:50:32.158575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:32.164545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1266/2522] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:32 2022] PUT /identity/v3/projects/567655407db74e1480c9cd5671145ccc/users/05e62d87775841e8af0b49f05c6d5fda/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:32.169382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db898-873d-4364-81eb-5be3d09017e0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:32.178075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.178496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.178775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.214255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] MFA Rules not processed for user `05e62d87775841e8af0b49f05c6d5fda`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:32.216251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:32.239165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e33986-a066-4077-bc28-b9de05a6da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:32.240055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33986-a066-4077-bc28-b9de05a6da6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.240336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33986-a066-4077-bc28-b9de05a6da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.240613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33986-a066-4077-bc28-b9de05a6da6f admin admin] PATH_INFO: `/v3/projects/8b3d59b1dbf14c70b717cb5f6ca37327/users/78d9c4cf74614359833be001d7d8dfef/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.242661 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e33986-a066-4077-bc28-b9de05a6da6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3d59b1dbf14c70b717cb5f6ca37327, user_id=78d9c4cf74614359833be001d7d8dfef, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:32.246320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e33986-a066-4077-bc28-b9de05a6da6f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:32.257624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1257/2523] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:32 2022] PUT /identity/v3/projects/8b3d59b1dbf14c70b717cb5f6ca37327/users/78d9c4cf74614359833be001d7d8dfef/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:32.269020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.269515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.269866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.292164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1267/2524] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:32.305321 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:32.307697 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:32.309406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] MFA Rules not processed for user `78d9c4cf74614359833be001d7d8dfef`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:32.310621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:32.382047 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18834f1f-912e-4b8b-a8de-f3118f0ba681 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:32.390387 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1258/2525] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:32.401790 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:32.403206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:32.438424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72317f5c187c41e9b2d1c53c9cedcd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:32.439009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.439292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.439568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.464659 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85450d-498e-4697-ba0c-f00c774f7251 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:32.468635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:32.469289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.469550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.469822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.523922 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:32.526436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:32.533909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:32.535698 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:32.536887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1268/2526] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:32.546396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1259/2527] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:50:32.788971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:32.796909 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:32.885471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab45d0-a0f4-40db-8044-0b2527dd415c service glance] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:32.894024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0b86e-b053-4e08-916a-54524bf37e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:32.897910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b86e-b053-4e08-916a-54524bf37e7b service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:32.897910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b86e-b053-4e08-916a-54524bf37e7b service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:32.897910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0b86e-b053-4e08-916a-54524bf37e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:32.897910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5ed0b86e-b053-4e08-916a-54524bf37e7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:32.960774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0b86e-b053-4e08-916a-54524bf37e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:32.963227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0b86e-b053-4e08-916a-54524bf37e7b service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:32.973849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1269/2528] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:36.783124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:36.844421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb5377-f3c6-4430-b555-d89d5bf669bd service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:36.848881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:36.849726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:36.850003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:36.850268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] PATH_INFO: `/v3/users/ca3c4e72548a44349980fc71071f72d8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:36.851585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3c4e72548a44349980fc71071f72d8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:36.854410 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:37.012289 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3c4e72548a44349980fc71071f72d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.061144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3c4e72548a44349980fc71071f72d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.061833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3c4e72548a44349980fc71071f72d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.062465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3c4e72548a44349980fc71071f72d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.069775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3c4e72548a44349980fc71071f72d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.092936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:37.093495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:37.093495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:37.094871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1260/2529] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:36 2022] DELETE /identity/v3/users/ca3c4e72548a44349980fc71071f72d8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:37.110632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:37.111850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:37.170003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1270/2530] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:37.179461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:37.180872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:37.237889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66e1bb-83c8-44fb-a5b0-9601923cc7fa admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:37.241442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:37.242069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:37.242344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:37.242613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:37.251725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:37.253189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:37.263910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1261/2531] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:37.646587 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:37.648204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:37.663645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fb805-d2f6-478f-8b99-2e164e7faa40 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:37.668613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:37.669527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:37.669808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:37.670082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] PATH_INFO: `/v3/projects/a457f04822fb49349ae3331399afabbb` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:37.671327 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a457f04822fb49349ae3331399afabbb)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:37.674878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:37.783204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a457f04822fb49349ae3331399afabbb', 'request_id': 'req-b9e21055-bdad-4c1b-86dc-420e951ebad0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.788318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a457f04822fb49349ae3331399afabbb', 'request_id': 'req-b9e21055-bdad-4c1b-86dc-420e951ebad0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.855239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a457f04822fb49349ae3331399afabbb', 'request_id': 'req-b9e21055-bdad-4c1b-86dc-420e951ebad0'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.867068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] The token cache is being invalidate because project a457f04822fb49349ae3331399afabbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:37.867540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.868191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:37.870295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1271/2532] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:37 2022] DELETE /identity/v3/projects/a457f04822fb49349ae3331399afabbb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:37.874689 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:37.885808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d17fd-e267-4884-8773-5d2e87337014 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:37.942231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:37.943531 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:37.944001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:37.944280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] PATH_INFO: `/v3/users/78d9c4cf74614359833be001d7d8dfef` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:37.945636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d9c4cf74614359833be001d7d8dfef)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:37.947970 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:38.115546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d9c4cf74614359833be001d7d8dfef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.157755 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d9c4cf74614359833be001d7d8dfef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.158376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d9c4cf74614359833be001d7d8dfef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.159021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d9c4cf74614359833be001d7d8dfef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.166892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7ae4c814-f8bf-4b3b-b643-7a8598b1b329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d9c4cf74614359833be001d7d8dfef'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.184677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1262/2533] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:50:37 2022] DELETE /identity/v3/users/78d9c4cf74614359833be001d7d8dfef => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:50:38.561441 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:38.563129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:38.577824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e21055-bdad-4c1b-86dc-420e951ebad0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:38.636427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:38.637190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:38.637475 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:38.637749 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] PATH_INFO: `/v3/projects/8b3d59b1dbf14c70b717cb5f6ca37327` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:38.638971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3d59b1dbf14c70b717cb5f6ca37327)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:38.640867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:38.798586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3d59b1dbf14c70b717cb5f6ca37327', 'request_id': 'req-dfab128a-d51e-4d84-bb54-d74ba550735c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.804690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3d59b1dbf14c70b717cb5f6ca37327', 'request_id': 'req-dfab128a-d51e-4d84-bb54-d74ba550735c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.934995 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3d59b1dbf14c70b717cb5f6ca37327', 'request_id': 'req-dfab128a-d51e-4d84-bb54-d74ba550735c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.946733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] The token cache is being invalidate because project 8b3d59b1dbf14c70b717cb5f6ca37327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:50:38.947582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.948282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-dfab128a-d51e-4d84-bb54-d74ba550735c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:50:38.949804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1272/2534] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:50:38 2022] DELETE /identity/v3/projects/8b3d59b1dbf14c70b717cb5f6ca37327 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:38.955639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c6c1-d10a-4aea-b1d1-de50e0eab490 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:38.956147 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c6c1-d10a-4aea-b1d1-de50e0eab490 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:38.956259 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777c6c1-d10a-4aea-b1d1-de50e0eab490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:38.975228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5777c6c1-d10a-4aea-b1d1-de50e0eab490 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:38.976911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5777c6c1-d10a-4aea-b1d1-de50e0eab490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:39.035921 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1263/2535] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:39.044505 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715e26-30a5-4a2b-a06d-d3b2f60625bb None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.044798 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715e26-30a5-4a2b-a06d-d3b2f60625bb None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.045079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715e26-30a5-4a2b-a06d-d3b2f60625bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.064027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-a5715e26-30a5-4a2b-a06d-d3b2f60625bb None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:39.065190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a5715e26-30a5-4a2b-a06d-d3b2f60625bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:39.073740 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1273/2536] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:39.078124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c6c1-d10a-4aea-b1d1-de50e0eab490 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:39.089238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777c6c1-d10a-4aea-b1d1-de50e0eab490 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:39.094160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:39.094967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.095369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.095745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.096595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:50:39.096968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:39.098639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:39.112631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1264/2537] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:50:39.116726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715e26-30a5-4a2b-a06d-d3b2f60625bb None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:39.127107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715e26-30a5-4a2b-a06d-d3b2f60625bb None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:39.131818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:39.132462 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.132745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.133020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.133896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:39.135873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:39.229033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1274/2538] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:50:39 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:39.233089 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:39.243058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb979d-775c-4958-9686-64d62b7a047e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:39.298334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:39.299030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.299313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.299682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.300330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:39.302239 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:39.375556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1265/2539] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:50:39 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:50:39.380171 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:39.390536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc54c-d480-45ec-9d97-b3787b9fb4e8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:39.395772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:39.396456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.396765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.397063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.397803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:39.399480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:39.410999 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1275/2540] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:39.415027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:39.425731 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3286a9-0e68-4f1d-a0cc-b19a3c6de1d0 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:39.430463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4ab19-91a2-4c6c-be02-eedae8d3e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:39.431275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ab19-91a2-4c6c-be02-eedae8d3e791 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.431275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ab19-91a2-4c6c-be02-eedae8d3e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.431886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4ab19-91a2-4c6c-be02-eedae8d3e791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.432476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4ab19-91a2-4c6c-be02-eedae8d3e791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:39.434064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4ab19-91a2-4c6c-be02-eedae8d3e791 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:39.444234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1266/2541] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:50:39.448929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:39.458730 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3841a-d028-416f-9a91-2cba53858052 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:39.463910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:39.464767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.465048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.465324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] PATH_INFO: `/v3/projects/cc3f8d5edc6a418a90a54972adb055ab/users/92c9726c4c8a47b6a0ec38d41a54c889/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.480348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3f8d5edc6a418a90a54972adb055ab, user_id=92c9726c4c8a47b6a0ec38d41a54c889, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:39.482996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:39.570371 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1276/2542] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:50:39 2022] PUT /identity/v3/projects/cc3f8d5edc6a418a90a54972adb055ab/users/92c9726c4c8a47b6a0ec38d41a54c889/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:50:39.581055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7316826-6eb2-4678-9f0b-8fc0bc84c993 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.581355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7316826-6eb2-4678-9f0b-8fc0bc84c993 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.581614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7316826-6eb2-4678-9f0b-8fc0bc84c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.609026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-c7316826-6eb2-4678-9f0b-8fc0bc84c993 None None] MFA Rules not processed for user `92c9726c4c8a47b6a0ec38d41a54c889`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:39.610220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c7316826-6eb2-4678-9f0b-8fc0bc84c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:39.673556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1267/2543] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:39.683182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:39.684828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:39.746815 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671602a9-322d-4a40-823e-0f09e7b15c37 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:39.750465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:39.751130 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:39.751412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:39.751944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:39.760821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:39.762245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:39.771434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1277/2544] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:50:42.541194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:42.541865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:42.541865 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:42.559985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] MFA Rules not processed for user `92c9726c4c8a47b6a0ec38d41a54c889`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:50:42.567189 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:42.568688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1268/2545] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:50:43.134031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:50:43.135787 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:43.224273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391399-4220-4ccb-92f9-0d0e2e595865 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:50:43.230356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:50:43.231120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:50:43.231400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:50:43.231717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:50:43.233544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:50:43.248760 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:50:43.250632 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:50:43.262803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1278/2546] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:50:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:09.992154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:09.993731 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:10.050893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2ec0c-293c-435a-ba27-1911521f253a None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:10.054663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8e9e0-da2e-48a4-9806-234a88b8f083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:10.055326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8e9e0-da2e-48a4-9806-234a88b8f083 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:10.055610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8e9e0-da2e-48a4-9806-234a88b8f083 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:10.055881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8e9e0-da2e-48a4-9806-234a88b8f083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:10.059687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0ee8e9e0-da2e-48a4-9806-234a88b8f083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:10.069650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8e9e0-da2e-48a4-9806-234a88b8f083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:10.071109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8e9e0-da2e-48a4-9806-234a88b8f083 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:10.083559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1269/2547] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:10.095331 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:10.097944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:10.110117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac468c-4d27-4ec4-9e8f-9694da7033fd service placement] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:10.113681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:10.114316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:10.114590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:10.114923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:10.122341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:10.123970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:10.132636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1279/2548] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:12.852233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:12.853132 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:12.853409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:12.871896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:12.873099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:12.927389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1270/2549] 10.222.0.21 () {58 vars in 967 bytes} [Mon Jan 31 04:51:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:12.949878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:12.952076 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:13.025631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59b587-b74b-4df1-88f6-eb197214ec6d service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:13.030933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aae30-f010-421f-aadc-450c7b5bca34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:13.032965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aae30-f010-421f-aadc-450c7b5bca34 service swift] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:13.032965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aae30-f010-421f-aadc-450c7b5bca34 service swift] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:13.032965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aae30-f010-421f-aadc-450c7b5bca34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:13.040452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aae30-f010-421f-aadc-450c7b5bca34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:13.042039 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aae30-f010-421f-aadc-450c7b5bca34 service swift] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:13.050028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1280/2550] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:51:13.788159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:13.791359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:13.857598 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24633-d8df-40b0-838d-7ad036f682a0 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:13.862374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:13.863273 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:13.863556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:13.863836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] PATH_INFO: `/v3/users/05e62d87775841e8af0b49f05c6d5fda` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:13.865082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e62d87775841e8af0b49f05c6d5fda)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:13.867030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:14.048240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e62d87775841e8af0b49f05c6d5fda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.112166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e62d87775841e8af0b49f05c6d5fda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.113524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e62d87775841e8af0b49f05c6d5fda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.120352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e62d87775841e8af0b49f05c6d5fda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.128376 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e62d87775841e8af0b49f05c6d5fda'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.153847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1271/2551] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:51:13 2022] DELETE /identity/v3/users/05e62d87775841e8af0b49f05c6d5fda => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:51:14.157535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:14.158027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:14.158139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:14.175385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:14.176590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:14.236960 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1281/2552] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:14.247836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:14.249454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:14.310946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887f878-4a2d-4a42-b60d-f3d60e3a8b95 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:14.313270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a846-bc75-48be-8854-00fc1eccdb87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:14.313911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a846-bc75-48be-8854-00fc1eccdb87 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:14.314190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a846-bc75-48be-8854-00fc1eccdb87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:14.314461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a846-bc75-48be-8854-00fc1eccdb87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:14.323778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5a846-bc75-48be-8854-00fc1eccdb87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:14.325892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5a846-bc75-48be-8854-00fc1eccdb87 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:14.335635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1272/2553] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:14.705752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:14.708808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:14.719383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939ca68-1018-4061-bd62-8ccfc4390d9c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:14.723906 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:14.724776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:14.725050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:14.725320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] PATH_INFO: `/v3/projects/567655407db74e1480c9cd5671145ccc` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:14.726490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] RBAC: Authorizing `identity:delete_project(project_id=567655407db74e1480c9cd5671145ccc)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:14.731223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:14.820228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567655407db74e1480c9cd5671145ccc', 'request_id': 'req-a1787d6b-07c2-40b6-8912-7e432969259d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.826297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567655407db74e1480c9cd5671145ccc', 'request_id': 'req-a1787d6b-07c2-40b6-8912-7e432969259d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.877524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567655407db74e1480c9cd5671145ccc', 'request_id': 'req-a1787d6b-07c2-40b6-8912-7e432969259d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.888320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] The token cache is being invalidate because project 567655407db74e1480c9cd5671145ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:51:14.888605 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.893809 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a1787d6b-07c2-40b6-8912-7e432969259d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:14.893809 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1282/2554] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:51:14 2022] DELETE /identity/v3/projects/567655407db74e1480c9cd5671145ccc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:14.896389 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54e2e-c485-42cb-8627-f8e490200370 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:14.896854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54e2e-c485-42cb-8627-f8e490200370 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:14.896948 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54e2e-c485-42cb-8627-f8e490200370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:14.915014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5dd54e2e-c485-42cb-8627-f8e490200370 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:14.916187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5dd54e2e-c485-42cb-8627-f8e490200370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:14.972296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1273/2555] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:51:14.980154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9668-f1d8-4b0b-9097-8ccfeb57fd57 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:14.980442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9668-f1d8-4b0b-9097-8ccfeb57fd57 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:14.981292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9668-f1d8-4b0b-9097-8ccfeb57fd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:14.999030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-84cd9668-f1d8-4b0b-9097-8ccfeb57fd57 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:15.000226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-84cd9668-f1d8-4b0b-9097-8ccfeb57fd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:15.008570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1283/2556] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:51:15.013206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd54e2e-c485-42cb-8627-f8e490200370 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.022837 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd54e2e-c485-42cb-8627-f8e490200370 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.028074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.028712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.028986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.029253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.029978 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:51:15.030281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.032135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.043636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1274/2557] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:51:15.048000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9668-f1d8-4b0b-9097-8ccfeb57fd57 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.057382 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9668-f1d8-4b0b-9097-8ccfeb57fd57 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.062391 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.063061 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.063341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.063614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.064355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.066238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.137712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1284/2558] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:51:15 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:51:15.140979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.150915 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17942876-c738-4c3e-82e4-7b5f1864904b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.207374 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.208032 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.208310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.208695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.209409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.211335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.281560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1275/2559] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:51:15 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:51:15.282586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.293826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a338d8-6a47-42ca-837a-0dd8b433dd11 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.298868 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.301928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.301928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.301928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.301928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.302644 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.317642 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1285/2560] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:51:15.321930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.332327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1d6e3-dff0-40b0-9c33-8dd84e07143e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.337033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e348f-9d38-4cd7-a0b8-6cbd6d853843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.337691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e348f-9d38-4cd7-a0b8-6cbd6d853843 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.337971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e348f-9d38-4cd7-a0b8-6cbd6d853843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.338246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e348f-9d38-4cd7-a0b8-6cbd6d853843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.339247 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e348f-9d38-4cd7-a0b8-6cbd6d853843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.343562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e348f-9d38-4cd7-a0b8-6cbd6d853843 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.351639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1276/2561] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:51:15.356403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.366344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a351f-95a7-4c1b-9d0b-2a374878901d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.371345 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.372450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.372864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.373203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] PATH_INFO: `/v3/projects/44f1314c62e043ab9be51bfbf7a751ff/users/086792fa592a442da2c8926c6aac719a/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.388184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f1314c62e043ab9be51bfbf7a751ff, user_id=086792fa592a442da2c8926c6aac719a, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.390856 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.460589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1286/2562] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:51:15 2022] PUT /identity/v3/projects/44f1314c62e043ab9be51bfbf7a751ff/users/086792fa592a442da2c8926c6aac719a/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:15.472138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac677-78fd-4dcd-aa64-80db57b8eda9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.472425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac677-78fd-4dcd-aa64-80db57b8eda9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.472777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac677-78fd-4dcd-aa64-80db57b8eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.502397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9fbac677-78fd-4dcd-aa64-80db57b8eda9 None None] MFA Rules not processed for user `086792fa592a442da2c8926c6aac719a`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:15.507131 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9fbac677-78fd-4dcd-aa64-80db57b8eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:15.568833 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1277/2563] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:15.573223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.636030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1b7d4-eb68-4a99-b050-c930d47bf767 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.642054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.642636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.642945 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.643221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.643917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.645803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.730255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1287/2564] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:51:15 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:51:15.734366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac677-78fd-4dcd-aa64-80db57b8eda9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.744979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac677-78fd-4dcd-aa64-80db57b8eda9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.798321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.799014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.799297 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.799560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.800254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.802157 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.889099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1278/2565] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:51:15 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:51:15.893064 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.903807 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe2e0b-6643-4de6-9ebf-31a7c2a0812b admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.908586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.909227 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.909532 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.909908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.910771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.912385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.922844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1288/2566] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:51:15.926841 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.936742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364f45-0a10-410c-b6af-ef164e05fab9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.941352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caaad5b-509f-4945-80b5-c7eb1e1f1ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.942011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaad5b-509f-4945-80b5-c7eb1e1f1ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.942292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaad5b-509f-4945-80b5-c7eb1e1f1ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.942566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caaad5b-509f-4945-80b5-c7eb1e1f1ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.943335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caaad5b-509f-4945-80b5-c7eb1e1f1ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.944941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caaad5b-509f-4945-80b5-c7eb1e1f1ae5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:15.958613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1279/2567] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:51:15.960059 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:15.970556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6856044-c9c6-4db2-90de-56869e1ee9e0 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:15.975274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:15.976141 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:15.976419 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:15.976694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] PATH_INFO: `/v3/projects/12738e848b73448f90d1dc7fd06dc4f8/users/f402e84e553542aca00f920b2a4021f4/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:15.991400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=12738e848b73448f90d1dc7fd06dc4f8, user_id=f402e84e553542aca00f920b2a4021f4, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:15.994106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.078525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1289/2568] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:51:15 2022] PUT /identity/v3/projects/12738e848b73448f90d1dc7fd06dc4f8/users/f402e84e553542aca00f920b2a4021f4/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:16.088754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051787-b179-4495-980d-c6b7378fa1fa None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.089041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051787-b179-4495-980d-c6b7378fa1fa None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.089316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051787-b179-4495-980d-c6b7378fa1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.117775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f4051787-b179-4495-980d-c6b7378fa1fa None None] MFA Rules not processed for user `f402e84e553542aca00f920b2a4021f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:16.119027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f4051787-b179-4495-980d-c6b7378fa1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:16.180683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1280/2569] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:16.185840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.244528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364cfab-aa6e-438c-aad4-e220e4514bdd admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:16.250126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:16.250816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.252092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.252368 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.253223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:16.255502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.353542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1290/2570] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:51:16 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:51:16.358585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4051787-b179-4495-980d-c6b7378fa1fa None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.369051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4051787-b179-4495-980d-c6b7378fa1fa None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:16.436361 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:16.437075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.438053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.438440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.439380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:16.441396 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.501355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.503239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:16.548940 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1281/2571] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:51:16 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:51:16.552944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.571851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cb347-ba5f-464a-b6f5-92a093faceea admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:16.589603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:16.591436 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.591772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.591994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.592758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:16.594367 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.609965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1282/2572] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:51:16.620393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdac35-193f-461a-b961-46314e0f63b3 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:16.624286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.628199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:16.628925 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.629275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.629621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.631569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:16.638284 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38807-ebe0-48ac-80e0-cacff83eefbc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:16.643042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:16.643922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.644201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.644471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] PATH_INFO: `/v3/projects/70f4d714dbd34916980dfab7f1e808b4/users/fa5a761240564dd09fcef0e189935730/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.645847 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:16.648182 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.660821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1291/2573] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:51:16.661004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f4d714dbd34916980dfab7f1e808b4, user_id=fa5a761240564dd09fcef0e189935730, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:16.663903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.728955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1283/2574] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:51:16 2022] PUT /identity/v3/projects/70f4d714dbd34916980dfab7f1e808b4/users/fa5a761240564dd09fcef0e189935730/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:16.733308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.743722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f5d9-d59a-4334-8234-386cb3f098bd service nova] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:16.801568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5274-d924-4a53-be92-af13add93aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:16.802236 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5274-d924-4a53-be92-af13add93aff admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.802514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5274-d924-4a53-be92-af13add93aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.802782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5274-d924-4a53-be92-af13add93aff admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.803538 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b5274-d924-4a53-be92-af13add93aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:16.805197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b5274-d924-4a53-be92-af13add93aff admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.816824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1292/2575] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:51:16.822394 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.832371 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c270022-8123-4748-b893-1766f885ca0a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:16.836975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:16.837910 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.838188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.838461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] PATH_INFO: `/v3/projects/70f4d714dbd34916980dfab7f1e808b4/users/fa5a761240564dd09fcef0e189935730/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.840991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f4d714dbd34916980dfab7f1e808b4, user_id=fa5a761240564dd09fcef0e189935730, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:16.844766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:16.854007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1284/2576] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:51:16 2022] PUT /identity/v3/projects/70f4d714dbd34916980dfab7f1e808b4/users/fa5a761240564dd09fcef0e189935730/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:51:16.864043 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29687-598b-4ff0-aea5-b9ab264b7859 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:16.867769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29687-598b-4ff0-aea5-b9ab264b7859 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:16.867769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29687-598b-4ff0-aea5-b9ab264b7859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:16.892380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9ff29687-598b-4ff0-aea5-b9ab264b7859 None None] MFA Rules not processed for user `fa5a761240564dd09fcef0e189935730`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:16.893643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9ff29687-598b-4ff0-aea5-b9ab264b7859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:16.960621 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1293/2577] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:16.970635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:16.972316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:17.029184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c5a2f-255e-4fb2-841d-e8761471577e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:17.032725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:17.033348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:17.033626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:17.033897 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:17.086691 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:17.088159 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:17.097854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1285/2578] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:17.819161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c34d3-d0cb-4243-bafb-851448a1f7f9 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:17.819668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c34d3-d0cb-4243-bafb-851448a1f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:17.819774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c34d3-d0cb-4243-bafb-851448a1f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:17.838324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-af7c34d3-d0cb-4243-bafb-851448a1f7f9 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:17.839478 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-af7c34d3-d0cb-4243-bafb-851448a1f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:17.897954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1294/2579] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:51:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:17.909750 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:17.911204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:17.982885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcf115-369c-495f-ad53-f6af149ffa10 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:17.987822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:17.988445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:17.988722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:17.988990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:17.997305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:17.998881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:18.009498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1286/2580] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:51:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:51:18.838193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222965a-75e1-4899-b645-b5469077958d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:18.838648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222965a-75e1-4899-b645-b5469077958d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:18.838825 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222965a-75e1-4899-b645-b5469077958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:18.857324 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-7222965a-75e1-4899-b645-b5469077958d None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:18.858448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7222965a-75e1-4899-b645-b5469077958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:18.865576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1295/2581] 10.222.0.21 () {58 vars in 967 bytes} [Mon Jan 31 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:18.879368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:18.890813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c79f-766e-4429-9321-204423fae39e service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:18.896067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e07f3-f44f-4b23-8580-0150ced380a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:18.896700 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e07f3-f44f-4b23-8580-0150ced380a7 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:18.896979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e07f3-f44f-4b23-8580-0150ced380a7 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:18.897252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e07f3-f44f-4b23-8580-0150ced380a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:18.906745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e07f3-f44f-4b23-8580-0150ced380a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:18.908356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e07f3-f44f-4b23-8580-0150ced380a7 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:18.916650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1287/2582] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:51:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:51:18.948113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222965a-75e1-4899-b645-b5469077958d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:18.958068 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222965a-75e1-4899-b645-b5469077958d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:18.961597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:18.962221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:18.971880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:18.971880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:19.017813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:19.019447 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:19.028780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1296/2583] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:19.482720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff41c0-2bc9-4f71-8eef-c8650bd15481 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:19.483214 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff41c0-2bc9-4f71-8eef-c8650bd15481 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:19.483347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff41c0-2bc9-4f71-8eef-c8650bd15481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:19.501866 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-85ff41c0-2bc9-4f71-8eef-c8650bd15481 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:19.503083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-85ff41c0-2bc9-4f71-8eef-c8650bd15481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:19.510275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1288/2584] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:51:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:51:19.524963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:19.534733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8850a-0b78-479b-8ef2-11a30e5bb91e service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:19.539799 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:19.540429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:19.540714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:19.540991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:19.552103 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:19.553693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:19.562329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1297/2585] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:51:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:51:20.029224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d6908-b93c-4775-a9a7-45e60032679e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:20.029490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d6908-b93c-4775-a9a7-45e60032679e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:20.029757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d6908-b93c-4775-a9a7-45e60032679e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:20.047429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-854d6908-b93c-4775-a9a7-45e60032679e None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:20.048631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-854d6908-b93c-4775-a9a7-45e60032679e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:20.055674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1289/2586] 10.222.0.21 () {58 vars in 967 bytes} [Mon Jan 31 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:20.069256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:20.080778 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a255a4-8416-4840-9f44-0255826f3305 service swift] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:20.086646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:20.087362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:20.087633 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:20.087942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:20.096569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:20.098159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:20.107102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1298/2587] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:51:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:51:20.381782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d6908-b93c-4775-a9a7-45e60032679e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:20.395400 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d6908-b93c-4775-a9a7-45e60032679e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:20.399580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9655098-9607-406c-94a4-a1f8c4c8f0f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:20.400663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9655098-9607-406c-94a4-a1f8c4c8f0f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:20.401101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9655098-9607-406c-94a4-a1f8c4c8f0f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:20.401528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9655098-9607-406c-94a4-a1f8c4c8f0f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:20.413330 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9655098-9607-406c-94a4-a1f8c4c8f0f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:20.414924 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9655098-9607-406c-94a4-a1f8c4c8f0f5 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:20.425933 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1290/2588] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:22.660028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:22.661453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:22.723194 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f0b4c-f789-41d9-8935-de8473d5804d service swift] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:22.727640 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:22.728483 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:22.728758 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:22.729025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] PATH_INFO: `/v3/users/92c9726c4c8a47b6a0ec38d41a54c889` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:22.730196 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c9726c4c8a47b6a0ec38d41a54c889)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:22.732298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:22.906777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c9726c4c8a47b6a0ec38d41a54c889'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:22.907394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c9726c4c8a47b6a0ec38d41a54c889'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:22.918834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c9726c4c8a47b6a0ec38d41a54c889'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:22.925549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c9726c4c8a47b6a0ec38d41a54c889'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:22.973920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c9726c4c8a47b6a0ec38d41a54c889'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:22.979974 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1299/2589] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:51:22 2022] DELETE /identity/v3/users/92c9726c4c8a47b6a0ec38d41a54c889 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:22.984723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:22.985225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:22.985332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:23.003124 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:23.004314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:23.059203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1291/2590] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:51:23.069319 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:23.070707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:23.127805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d1fad-14cc-4f83-8077-e51a7d9637e5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:23.131458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:23.132089 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:23.132372 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:23.132646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:23.141362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:23.142805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:23.152114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1300/2591] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:23.359337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:23.360887 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:23.373031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868bfcd-c2a2-4bdd-aedc-941d1b722ac5 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:23.378349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:23.379336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:23.380114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:23.380114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] PATH_INFO: `/v3/projects/cc3f8d5edc6a418a90a54972adb055ab` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:23.381423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3f8d5edc6a418a90a54972adb055ab)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:23.383484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:23.511810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3f8d5edc6a418a90a54972adb055ab', 'request_id': 'req-0206c4e8-b383-4ce0-b28a-1a8ff211b433'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:23.597549 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3f8d5edc6a418a90a54972adb055ab', 'request_id': 'req-0206c4e8-b383-4ce0-b28a-1a8ff211b433'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:23.604298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3f8d5edc6a418a90a54972adb055ab', 'request_id': 'req-0206c4e8-b383-4ce0-b28a-1a8ff211b433'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:23.615054 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] The token cache is being invalidate because project cc3f8d5edc6a418a90a54972adb055ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:51:23.615340 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:23.615968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0206c4e8-b383-4ce0-b28a-1a8ff211b433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:23.617515 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1292/2592] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:51:23 2022] DELETE /identity/v3/projects/cc3f8d5edc6a418a90a54972adb055ab => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:29.281923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:29.286548 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:29.297439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e95be8-457a-4542-aad5-5b103e1a9962 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:29.359700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:29.360570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:29.361075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:29.361409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] PATH_INFO: `/v3/users/086792fa592a442da2c8926c6aac719a` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:29.362677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086792fa592a442da2c8926c6aac719a)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:29.364799 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:29.550008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086792fa592a442da2c8926c6aac719a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:29.550720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086792fa592a442da2c8926c6aac719a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:29.564274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086792fa592a442da2c8926c6aac719a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:29.571025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086792fa592a442da2c8926c6aac719a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:29.631584 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086792fa592a442da2c8926c6aac719a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:29.639310 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1301/2593] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:51:29 2022] DELETE /identity/v3/users/086792fa592a442da2c8926c6aac719a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:51:29.644002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:29.644587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:29.644587 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:29.662895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:29.664099 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:29.720588 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1293/2594] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:29.730298 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:29.731736 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:29.788033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48a26d-4982-4c0a-b853-a30958488056 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:29.791802 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:29.792433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:29.792715 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:29.792986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:29.803332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:29.804763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:29.814005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1302/2595] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:30.147824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:30.149532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:30.163285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830d83d-13d7-4a36-bf6c-e8e42763cfa3 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:30.167954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:30.168798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:30.169079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:30.169353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] PATH_INFO: `/v3/projects/44f1314c62e043ab9be51bfbf7a751ff` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:30.171348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f1314c62e043ab9be51bfbf7a751ff)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:30.173258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:30.260429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f1314c62e043ab9be51bfbf7a751ff', 'request_id': 'req-1154bff2-4051-4426-9ed1-9dfe465bccdf'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.317037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f1314c62e043ab9be51bfbf7a751ff', 'request_id': 'req-1154bff2-4051-4426-9ed1-9dfe465bccdf'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.323992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f1314c62e043ab9be51bfbf7a751ff', 'request_id': 'req-1154bff2-4051-4426-9ed1-9dfe465bccdf'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.334664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] The token cache is being invalidate because project 44f1314c62e043ab9be51bfbf7a751ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:51:30.334992 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.335626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.337514 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1294/2596] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:51:30 2022] DELETE /identity/v3/projects/44f1314c62e043ab9be51bfbf7a751ff => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:30.341468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:30.351436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849635d-aa2a-4136-8ca5-d8977e543e98 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:30.407686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:30.408531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:30.408807 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:30.409077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] PATH_INFO: `/v3/users/f402e84e553542aca00f920b2a4021f4` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:30.410264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f402e84e553542aca00f920b2a4021f4)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:30.412186 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:30.582338 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f402e84e553542aca00f920b2a4021f4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.582930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f402e84e553542aca00f920b2a4021f4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.594783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f402e84e553542aca00f920b2a4021f4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.601699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f402e84e553542aca00f920b2a4021f4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.665417 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f402e84e553542aca00f920b2a4021f4'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:30.672109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1303/2597] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:51:30 2022] DELETE /identity/v3/users/f402e84e553542aca00f920b2a4021f4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:31.044332 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:31.046522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:31.063112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154bff2-4051-4426-9ed1-9dfe465bccdf admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:31.121857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:31.122663 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:31.122985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:31.123264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] PATH_INFO: `/v3/projects/12738e848b73448f90d1dc7fd06dc4f8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:31.124474 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12738e848b73448f90d1dc7fd06dc4f8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:31.126670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:31.213812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12738e848b73448f90d1dc7fd06dc4f8', 'request_id': 'req-4ac2b111-d512-44d8-8555-d95925b47e5d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.277077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12738e848b73448f90d1dc7fd06dc4f8', 'request_id': 'req-4ac2b111-d512-44d8-8555-d95925b47e5d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.284451 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12738e848b73448f90d1dc7fd06dc4f8', 'request_id': 'req-4ac2b111-d512-44d8-8555-d95925b47e5d'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.295110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] The token cache is being invalidate because project 12738e848b73448f90d1dc7fd06dc4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:51:31.295397 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.296030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.297722 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1295/2598] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:51:31 2022] DELETE /identity/v3/projects/12738e848b73448f90d1dc7fd06dc4f8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:31.301690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:31.303139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:31.315673 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec231e7-da9a-4219-bff9-6b5f438e17eb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:31.371163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:31.372075 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:31.372305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:31.372579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] PATH_INFO: `/v3/users/fa5a761240564dd09fcef0e189935730` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:31.373770 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5a761240564dd09fcef0e189935730)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:31.376230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:31.535583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5a761240564dd09fcef0e189935730'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.536225 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5a761240564dd09fcef0e189935730'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.548086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5a761240564dd09fcef0e189935730'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.554766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5a761240564dd09fcef0e189935730'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.613908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-9f6da23c-bab5-4126-9736-2c8150ea607e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5a761240564dd09fcef0e189935730'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:31.620005 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1304/2599] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:51:31 2022] DELETE /identity/v3/users/fa5a761240564dd09fcef0e189935730 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:51:32.016609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:32.018211 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:32.031134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2b111-d512-44d8-8555-d95925b47e5d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:32.088027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:32.089546 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:32.089836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:32.090112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] PATH_INFO: `/v3/projects/70f4d714dbd34916980dfab7f1e808b4` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:32.091353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f4d714dbd34916980dfab7f1e808b4)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:32.093264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:32.167553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f4d714dbd34916980dfab7f1e808b4', 'request_id': 'req-e1f0d218-fd8b-40ed-a892-f566bd6226b8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:32.214006 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f4d714dbd34916980dfab7f1e808b4', 'request_id': 'req-e1f0d218-fd8b-40ed-a892-f566bd6226b8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:32.220634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f4d714dbd34916980dfab7f1e808b4', 'request_id': 'req-e1f0d218-fd8b-40ed-a892-f566bd6226b8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:32.230628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] The token cache is being invalidate because project 70f4d714dbd34916980dfab7f1e808b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:51:32.230959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:32.231585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:51:32.233111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1296/2600] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:51:32 2022] DELETE /identity/v3/projects/70f4d714dbd34916980dfab7f1e808b4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:51:34.069418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:34.069918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:34.070037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:34.086913 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] MFA Rules not processed for user `67b2e5f365144062bd2612f5d3ebd077`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:51:34.088099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:34.141939 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1305/2601] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:51:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:51:34.365759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:34.367235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:34.423813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0d218-fd8b-40ed-a892-f566bd6226b8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:34.427429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:34.428063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:34.428345 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:34.428621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:34.430358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:34.439463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:34.440888 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:34.448560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1297/2602] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:51:37.960033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:37.962175 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:38.036048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89ac9b-2b86-429a-9196-9058da161d37 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:38.041536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:38.042176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:38.042455 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:38.042729 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:38.044526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:38.057308 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:38.059034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:38.069886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1306/2603] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:51:42.817990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:51:42.831870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56375c1-b4a6-4eff-bc60-481538a82050 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:51:42.837378 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11bbf1-c5cf-4a00-b147-6eca75d80fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:51:42.838012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bbf1-c5cf-4a00-b147-6eca75d80fb6 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:51:42.838296 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bbf1-c5cf-4a00-b147-6eca75d80fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:51:42.838572 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11bbf1-c5cf-4a00-b147-6eca75d80fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:51:42.840388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7a11bbf1-c5cf-4a00-b147-6eca75d80fb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:51:42.853362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bbf1-c5cf-4a00-b147-6eca75d80fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:51:42.854956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11bbf1-c5cf-4a00-b147-6eca75d80fb6 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:51:42.868288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1298/2604] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:51:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:52:09.815330 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:09.826889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c97e93-ef38-43a4-b242-29d94fb52b40 service nova] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:09.832203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:09.833477 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:09.833745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:09.834015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:09.835790 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:09.891677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:09.893254 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:09.902861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1307/2605] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:52:42.656056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:42.656597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:42.656597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:42.674916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] MFA Rules not processed for user `aa68ebb7220c4e6383128947fc970877`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:52:42.676113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:42.731885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1299/2606] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:52:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:52:43.219148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:43.221143 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:43.233097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf4d47-94ba-4b5c-a966-798ec83b84cf service nova] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:43.236725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:43.237354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:43.237629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:43.237899 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:43.239878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:43.250636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:43.252077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:43.261439 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1308/2607] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:52:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:52:43.348798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:43.350315 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:43.417700 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac15334-6b2a-4ad4-bffa-0a697f0ee0c4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:43.422256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:43.423138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:43.423542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:43.423817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] PATH_INFO: `/v3/users/67b2e5f365144062bd2612f5d3ebd077` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:43.425137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b2e5f365144062bd2612f5d3ebd077)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:43.427086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:43.592942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b2e5f365144062bd2612f5d3ebd077'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:43.699674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b2e5f365144062bd2612f5d3ebd077'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:43.700355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b2e5f365144062bd2612f5d3ebd077'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:43.700902 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b2e5f365144062bd2612f5d3ebd077'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:43.708945 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-a1f11775-08dc-4d31-9ec9-74f7ba924099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b2e5f365144062bd2612f5d3ebd077'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:43.738906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1300/2608] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:52:43 2022] DELETE /identity/v3/users/67b2e5f365144062bd2612f5d3ebd077 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:52:43.998821 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:44.011186 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55586643-e661-494b-8a40-f59ee5e98c76 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:44.066997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:44.067842 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.068120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.068390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] PATH_INFO: `/v3/projects/32bc488217794302b16e40a559bec3c8` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.069570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bc488217794302b16e40a559bec3c8)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:44.072136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:44.218192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bc488217794302b16e40a559bec3c8', 'request_id': 'req-5b11a532-00b1-423a-93d8-13e0e209a91a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:44.223448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bc488217794302b16e40a559bec3c8', 'request_id': 'req-5b11a532-00b1-423a-93d8-13e0e209a91a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:44.299415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bc488217794302b16e40a559bec3c8', 'request_id': 'req-5b11a532-00b1-423a-93d8-13e0e209a91a'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:44.311674 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] The token cache is being invalidate because project 32bc488217794302b16e40a559bec3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:52:44.311962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:44.312585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b11a532-00b1-423a-93d8-13e0e209a91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:52:44.314125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1309/2609] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:52:43 2022] DELETE /identity/v3/projects/32bc488217794302b16e40a559bec3c8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:52:44.320641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f233b4-29e8-4e3a-bcaa-e944b3993801 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.320932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f233b4-29e8-4e3a-bcaa-e944b3993801 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.321210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f233b4-29e8-4e3a-bcaa-e944b3993801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.339162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f1f233b4-29e8-4e3a-bcaa-e944b3993801 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:52:44.340345 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f1f233b4-29e8-4e3a-bcaa-e944b3993801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:44.399465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1301/2610] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:52:44.407112 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92865e-c74d-4cf9-a3e4-36e7cb5f285e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.407402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92865e-c74d-4cf9-a3e4-36e7cb5f285e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.407678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92865e-c74d-4cf9-a3e4-36e7cb5f285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.426434 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-dc92865e-c74d-4cf9-a3e4-36e7cb5f285e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:52:44.427667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dc92865e-c74d-4cf9-a3e4-36e7cb5f285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:44.436370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1310/2611] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:52:44.440692 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f233b4-29e8-4e3a-bcaa-e944b3993801 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:44.450267 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f233b4-29e8-4e3a-bcaa-e944b3993801 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:44.454862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:44.455524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.455809 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.456082 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.456816 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:52:44.457121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:44.458742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:44.470644 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1302/2612] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 31 04:52:44.474723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92865e-c74d-4cf9-a3e4-36e7cb5f285e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:44.484502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92865e-c74d-4cf9-a3e4-36e7cb5f285e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:44.489243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:44.489924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.490240 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.490512 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.491265 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:44.493509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:44.581052 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1311/2613] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:52:44 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:52:44.585057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:44.595613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e7b1f-052c-4182-9de5-d3811f131c01 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:44.653201 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:44.653864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.654146 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.654421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.655180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:44.657138 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:44.725347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1303/2614] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:52:44 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:52:44.726964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:44.737494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360bae5-fe19-4643-b26c-a0f6378d60d2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:44.742144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:44.743820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.744099 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.744375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.745106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:44.746691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:44.756615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1312/2615] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:52:44.761057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:44.770586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56588bc-ef1e-46d4-b2eb-0a4b29ae4b85 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:44.776029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adcc12-8098-473b-bf95-279a8d016666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:44.776682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adcc12-8098-473b-bf95-279a8d016666 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.776961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adcc12-8098-473b-bf95-279a8d016666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.777232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adcc12-8098-473b-bf95-279a8d016666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.777965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adcc12-8098-473b-bf95-279a8d016666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:44.779566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adcc12-8098-473b-bf95-279a8d016666 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:44.790916 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1304/2616] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:52:44.794841 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:44.805559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f334-eba0-402e-b208-2add75813531 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:44.810980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:44.811851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.812128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.812399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] PATH_INFO: `/v3/projects/36c2584cb883458eaf6b3b04d55a9429/users/3a231040d254416cb6af258aed9f9278/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.828113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c2584cb883458eaf6b3b04d55a9429, user_id=3a231040d254416cb6af258aed9f9278, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:44.834552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:44.910983 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1313/2617] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:52:44 2022] PUT /identity/v3/projects/36c2584cb883458eaf6b3b04d55a9429/users/3a231040d254416cb6af258aed9f9278/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:52:44.916618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dff1d-cefa-4f9b-98e6-9f7512501962 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:44.917007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dff1d-cefa-4f9b-98e6-9f7512501962 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:44.917285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dff1d-cefa-4f9b-98e6-9f7512501962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:44.935358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ca1dff1d-cefa-4f9b-98e6-9f7512501962 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:52:44.936539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ca1dff1d-cefa-4f9b-98e6-9f7512501962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:44.994392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1305/2618] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:52:45.004155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:45.005894 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:45.061747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ecd79-75a8-4d44-9ebc-51c9d096b6ec admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:45.065376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:45.065997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:45.066273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:45.066597 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:45.075830 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:45.077242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:45.088488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1314/2619] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:52:50.555258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9bd60-4e41-4855-bdf8-12e506afec62 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:50.555712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9bd60-4e41-4855-bdf8-12e506afec62 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:50.555712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9bd60-4e41-4855-bdf8-12e506afec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:50.584067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-91c9bd60-4e41-4855-bdf8-12e506afec62 None None] MFA Rules not processed for user `3a231040d254416cb6af258aed9f9278`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:52:50.585486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-91c9bd60-4e41-4855-bdf8-12e506afec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:50.659699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1306/2620] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:52:50.664926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:50.675092 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d5ab-0b84-46b4-864b-14ea1adb5183 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:50.680243 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:50.681011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:50.681498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:50.681869 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:50.682908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:50.685329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:50.778151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1315/2621] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:52:50 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:52:50.780359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9bd60-4e41-4855-bdf8-12e506afec62 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:50.792372 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9bd60-4e41-4855-bdf8-12e506afec62 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:50.855631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:50.856444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:50.856838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:50.857213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:50.859912 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:50.862152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:50.940512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1307/2622] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:52:50 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:52:50.944920 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:50.958506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec145b-8133-4ddb-81dd-f0a9a3570e15 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:50.964638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:50.965318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:50.965592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:50.966057 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:50.967164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:50.968921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:50.991311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1316/2623] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:52:50.995603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:51.015283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a1714-e361-483c-95a3-700fe7a0b574 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:51.034416 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:51.035360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:51.035639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:51.035911 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] PATH_INFO: `/v3/projects/609ad2e21df74626a9c4eec39b67d8df/users/4f96c4d423ff42d2bd482b17cdc98d6a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:51.052194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=609ad2e21df74626a9c4eec39b67d8df, user_id=4f96c4d423ff42d2bd482b17cdc98d6a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:51.055039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:51.134885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1308/2624] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:52:50 2022] PUT /identity/v3/projects/609ad2e21df74626a9c4eec39b67d8df/users/4f96c4d423ff42d2bd482b17cdc98d6a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:52:51.138889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:51.149556 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dfe78-be1c-47c6-b21d-81a0f99902c9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:51.202857 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b9d9d-13fe-412e-aab9-30aa157bd4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:51.203522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9d9d-13fe-412e-aab9-30aa157bd4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:51.203804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9d9d-13fe-412e-aab9-30aa157bd4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:51.204080 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b9d9d-13fe-412e-aab9-30aa157bd4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:51.204805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b9d9d-13fe-412e-aab9-30aa157bd4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:51.206393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b9d9d-13fe-412e-aab9-30aa157bd4ab admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:51.216502 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1317/2625] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:52:51.220614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:51.230702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23443e6b-b9ce-4068-8912-af2d5d36c34a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:51.235234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:51.236088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:51.236365 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:51.236633 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] PATH_INFO: `/v3/projects/609ad2e21df74626a9c4eec39b67d8df/users/4f96c4d423ff42d2bd482b17cdc98d6a/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:51.238567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=609ad2e21df74626a9c4eec39b67d8df, user_id=4f96c4d423ff42d2bd482b17cdc98d6a, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:51.241212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:51.251834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1309/2626] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:52:51 2022] PUT /identity/v3/projects/609ad2e21df74626a9c4eec39b67d8df/users/4f96c4d423ff42d2bd482b17cdc98d6a/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:52:56.880115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e0d5-ae06-4eb7-8129-cb51a7e4871a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:56.880677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e0d5-ae06-4eb7-8129-cb51a7e4871a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:56.880677 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e0d5-ae06-4eb7-8129-cb51a7e4871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:56.907902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e192e0d5-ae06-4eb7-8129-cb51a7e4871a None None] MFA Rules not processed for user `4f96c4d423ff42d2bd482b17cdc98d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:52:56.909385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e192e0d5-ae06-4eb7-8129-cb51a7e4871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:56.975466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1318/2627] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:52:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:52:56.987404 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:52:56.989073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:52:57.069530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536b36d-7dbd-4f67-9813-dffedd2d98ca admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:52:57.075324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d064c3-e17a-4674-9d4d-a6a7a6602d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:52:57.075977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d064c3-e17a-4674-9d4d-a6a7a6602d3e service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:52:57.076253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d064c3-e17a-4674-9d4d-a6a7a6602d3e service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:52:57.076736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d064c3-e17a-4674-9d4d-a6a7a6602d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:52:57.152210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d064c3-e17a-4674-9d4d-a6a7a6602d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:52:57.153905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d064c3-e17a-4674-9d4d-a6a7a6602d3e service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:52:57.164283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1310/2628] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:52:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:53:00.060518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3563d21-43df-410b-8f69-83c1322662a3 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:53:00.061072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3563d21-43df-410b-8f69-83c1322662a3 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:53:00.061072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3563d21-43df-410b-8f69-83c1322662a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:53:00.096643 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f3563d21-43df-410b-8f69-83c1322662a3 None None] MFA Rules not processed for user `3a231040d254416cb6af258aed9f9278`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:53:00.098190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f3563d21-43df-410b-8f69-83c1322662a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:53:00.106711 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1319/2629] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:53:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:53:27.926738 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:53:27.927370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:53:27.927480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:53:27.947248 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] MFA Rules not processed for user `e72e8f061290417f8b8a4bb8a0d9d2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:53:27.948473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:53:28.007335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1311/2630] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:53:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:53:46.635326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3563d21-43df-410b-8f69-83c1322662a3 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:53:46.694076 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3563d21-43df-410b-8f69-83c1322662a3 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:53:46.698020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850116f-8881-442a-bd20-3ac6838e874b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:53:46.698664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850116f-8881-442a-bd20-3ac6838e874b service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:53:46.699066 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850116f-8881-442a-bd20-3ac6838e874b service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:53:46.699281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850116f-8881-442a-bd20-3ac6838e874b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:53:46.709286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850116f-8881-442a-bd20-3ac6838e874b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:53:46.710779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850116f-8881-442a-bd20-3ac6838e874b service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:53:46.721384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1320/2631] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:53:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:54:34.621043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:54:34.622741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:54:34.692148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86aa5-deb8-4ee6-a937-d920b37ac448 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:54:34.697307 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:54:34.697938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:54:34.698215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:54:34.698483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:54:34.700234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:54:34.712443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:54:34.714004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:54:34.724229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1312/2632] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:54:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:54:42.190379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf02e-108c-4648-b04d-5f863a475660 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:54:42.190886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf02e-108c-4648-b04d-5f863a475660 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:54:42.190996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf02e-108c-4648-b04d-5f863a475660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:54:42.208542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-daabf02e-108c-4648-b04d-5f863a475660 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:54:42.209724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-daabf02e-108c-4648-b04d-5f863a475660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:54:42.262000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1321/2633] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:54:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:54:42.377128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:54:42.378513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:54:42.444144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f5e0c-11bd-420b-8827-cb0d8b821463 service placement] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:54:42.448987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:54:42.449606 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:54:42.449883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:54:42.450154 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:54:42.457851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:54:42.459462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:54:42.467151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1313/2634] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:54:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:55:02.641285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d967-f38e-4051-ac58-f26e1744eed1 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:02.641776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d967-f38e-4051-ac58-f26e1744eed1 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:02.641875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99d967-f38e-4051-ac58-f26e1744eed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:02.659793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ba99d967-f38e-4051-ac58-f26e1744eed1 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:55:02.660978 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ba99d967-f38e-4051-ac58-f26e1744eed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:02.668120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1322/2635] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:55:02.680480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:02.691487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43b57a-8f1e-435c-afbd-6253999f7831 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:02.696487 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:02.697106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:02.697385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:02.697656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:02.705458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:02.707038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:02.714752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1314/2636] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:55:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 31 04:55:21.934055 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:21.934590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:21.934693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:21.953156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:55:21.954976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:21.962997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1323/2637] 10.222.0.21 () {58 vars in 967 bytes} [Mon Jan 31 04:55:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:55:21.976668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:21.987334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0e0c-b1de-4cff-9f4d-5409e4b059c2 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:21.992359 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:21.993030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:21.993319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:21.993597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:22.003116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:22.004718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:22.012941 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1315/2638] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:55:24.040018 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:24.041433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:24.053499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d379f-925e-4853-920d-1aa9b834f8bc None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:24.058293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:24.058916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:24.059197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:24.059466 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:24.061185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:24.075168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:24.076602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:24.089116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1324/2639] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:55:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:55:28.561044 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:28.570642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecff73-e948-4974-8d39-9a81948cd429 service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:28.574210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:28.574934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:28.575219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:28.575490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:28.577256 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:28.638007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:28.639465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:28.649781 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1316/2640] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:55:32.024132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:32.025191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:32.039100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec37e6c-87bf-4a59-ad8a-516d8e995931 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:32.043682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:32.044627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:32.044910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:32.045186 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] PATH_INFO: `/v3/users/e72e8f061290417f8b8a4bb8a0d9d2c1` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:32.046404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72e8f061290417f8b8a4bb8a0d9d2c1)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:32.048973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:32.179399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72e8f061290417f8b8a4bb8a0d9d2c1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.179942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72e8f061290417f8b8a4bb8a0d9d2c1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.193263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72e8f061290417f8b8a4bb8a0d9d2c1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.201296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72e8f061290417f8b8a4bb8a0d9d2c1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.280000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-f6b376bf-31b8-4a5c-82fe-7e435deb51c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72e8f061290417f8b8a4bb8a0d9d2c1'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.286882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1325/2641] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:55:32 2022] DELETE /identity/v3/users/e72e8f061290417f8b8a4bb8a0d9d2c1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:55:32.517019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:32.531797 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369720-3f9a-49e0-bfef-c0977aed8e89 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:32.591766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:32.592593 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:32.592871 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:32.593137 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] PATH_INFO: `/v3/projects/3dfe36d08de049af88fd724e90fbb0d5` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:32.594317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfe36d08de049af88fd724e90fbb0d5)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:32.596836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:32.695288 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfe36d08de049af88fd724e90fbb0d5', 'request_id': 'req-150471bf-f412-4b18-8719-198090e479a9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.800141 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfe36d08de049af88fd724e90fbb0d5', 'request_id': 'req-150471bf-f412-4b18-8719-198090e479a9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.806517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfe36d08de049af88fd724e90fbb0d5', 'request_id': 'req-150471bf-f412-4b18-8719-198090e479a9'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.817114 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] The token cache is being invalidate because project 3dfe36d08de049af88fd724e90fbb0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:55:32.817398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.818021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-150471bf-f412-4b18-8719-198090e479a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:55:32.819581 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1317/2642] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:55:32 2022] DELETE /identity/v3/projects/3dfe36d08de049af88fd724e90fbb0d5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:55:32.825303 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9528c1-e013-4167-a22a-e478220e5ea5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:32.825594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9528c1-e013-4167-a22a-e478220e5ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:32.831023 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9528c1-e013-4167-a22a-e478220e5ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:32.843492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-6b9528c1-e013-4167-a22a-e478220e5ea5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:55:32.844689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6b9528c1-e013-4167-a22a-e478220e5ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:32.902737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1326/2643] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:55:32.911199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266798-1383-48d1-b260-81dd682024ee None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:32.911482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266798-1383-48d1-b260-81dd682024ee None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:32.911752 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266798-1383-48d1-b260-81dd682024ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:32.929955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-49266798-1383-48d1-b260-81dd682024ee None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:55:32.931164 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-49266798-1383-48d1-b260-81dd682024ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:32.942476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1318/2644] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:55:32.946833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9528c1-e013-4167-a22a-e478220e5ea5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:32.957537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9528c1-e013-4167-a22a-e478220e5ea5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:32.962964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:32.963741 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:32.964016 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:32.964288 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:32.965038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:55:32.965340 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:32.967513 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:32.980737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1327/2645] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:55:32.984990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49266798-1383-48d1-b260-81dd682024ee None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:32.994672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49266798-1383-48d1-b260-81dd682024ee None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:32.999508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.000135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.000411 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.000681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.001406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.003314 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.086076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1319/2646] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:55:32 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:55:33.090394 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.102175 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445218fa-ddb8-4950-8f42-bf73fdbef772 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.161966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.162629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.162941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.163214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.163926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.165838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.246125 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1328/2647] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:55:33 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:55:33.250620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.261382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279c89a-7f73-4d99-b2f9-0e6a05298733 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.266423 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.267473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.267785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.268061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.268794 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.270369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.281139 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1320/2648] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:55:33.286567 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.297031 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48d74e-c9b9-4c24-81c8-695fd6b4d42c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.302844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77969aee-1257-4dbe-bc74-262fc5f97e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.303507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969aee-1257-4dbe-bc74-262fc5f97e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.303791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969aee-1257-4dbe-bc74-262fc5f97e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.304063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77969aee-1257-4dbe-bc74-262fc5f97e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.304794 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77969aee-1257-4dbe-bc74-262fc5f97e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.306823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77969aee-1257-4dbe-bc74-262fc5f97e10 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.318460 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1329/2649] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:55:33.323618 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.334462 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818824-02dd-4fdf-b8c4-1f5403545df4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.339528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.340355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.340624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.340890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] PATH_INFO: `/v3/projects/7286100e68ba4530bbcfeeff780527ec/users/81dc0d2675174c129651d9993c12cb55/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.356642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7286100e68ba4530bbcfeeff780527ec, user_id=81dc0d2675174c129651d9993c12cb55, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.359426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.452119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1321/2650] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:55:33 2022] PUT /identity/v3/projects/7286100e68ba4530bbcfeeff780527ec/users/81dc0d2675174c129651d9993c12cb55/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:55:33.465780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d35562-eb6a-4df4-96ff-f7a30c6db14b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.466062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d35562-eb6a-4df4-96ff-f7a30c6db14b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.468902 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d35562-eb6a-4df4-96ff-f7a30c6db14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.493458 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-06d35562-eb6a-4df4-96ff-f7a30c6db14b None None] MFA Rules not processed for user `81dc0d2675174c129651d9993c12cb55`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:55:33.494652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-06d35562-eb6a-4df4-96ff-f7a30c6db14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:33.558110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1330/2651] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:55:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:55:33.562687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.629240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684706b7-14d2-4f8d-bed2-e2e1ae9af461 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.634513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.635379 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.635727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.636046 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.636829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.638893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.745184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1322/2652] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:55:33 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:55:33.749484 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d35562-eb6a-4df4-96ff-f7a30c6db14b None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.759966 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d35562-eb6a-4df4-96ff-f7a30c6db14b None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.814344 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.815019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.815300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.815600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.816299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.818264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.886299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1331/2653] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:55:33 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:55:33.890399 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.900664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af2f6-8d32-4681-bd0b-c286783d8e4b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.905391 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.906038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.906320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.906595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.907979 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.909604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:33.920440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1323/2654] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:55:33.925427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:33.935390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b62258-f767-436f-be63-7d9b45898165 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:33.940695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:33.941595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:33.941872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:33.942140 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] PATH_INFO: `/v3/projects/18c76e19076943b5966c676c15b1661e/users/42d6c5b5ab7b453cb4e5a707ed90cf1c/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:33.957153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c76e19076943b5966c676c15b1661e, user_id=42d6c5b5ab7b453cb4e5a707ed90cf1c, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:33.960151 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:34.034401 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1332/2655] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:55:33 2022] PUT /identity/v3/projects/18c76e19076943b5966c676c15b1661e/users/42d6c5b5ab7b453cb4e5a707ed90cf1c/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:55:34.038339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:34.048753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b49a6-cbaf-47e6-b645-4c0f886e57f8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:34.105206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f259dd-1363-46f5-9ec8-5b7899110641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:34.105909 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f259dd-1363-46f5-9ec8-5b7899110641 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:34.106195 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f259dd-1363-46f5-9ec8-5b7899110641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:34.106498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f259dd-1363-46f5-9ec8-5b7899110641 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:34.107302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f259dd-1363-46f5-9ec8-5b7899110641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:34.108890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f259dd-1363-46f5-9ec8-5b7899110641 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:34.119161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1324/2656] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:55:34.123784 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:34.134689 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9a20-63c8-4df3-a4fe-c03aa8af4ca2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:34.139611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:34.140423 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:34.140700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:34.140968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] PATH_INFO: `/v3/projects/18c76e19076943b5966c676c15b1661e/users/42d6c5b5ab7b453cb4e5a707ed90cf1c/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:34.143041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c76e19076943b5966c676c15b1661e, user_id=42d6c5b5ab7b453cb4e5a707ed90cf1c, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:34.145737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:34.155935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1333/2657] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:55:34 2022] PUT /identity/v3/projects/18c76e19076943b5966c676c15b1661e/users/42d6c5b5ab7b453cb4e5a707ed90cf1c/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:55:34.166880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bf49-eecf-4e01-ac99-a0f4cd248b0d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:34.167174 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bf49-eecf-4e01-ac99-a0f4cd248b0d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:34.167454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bf49-eecf-4e01-ac99-a0f4cd248b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:34.194323 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-6214bf49-eecf-4e01-ac99-a0f4cd248b0d None None] MFA Rules not processed for user `42d6c5b5ab7b453cb4e5a707ed90cf1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:55:34.195570 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6214bf49-eecf-4e01-ac99-a0f4cd248b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:34.261788 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1325/2658] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:55:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:55:34.272214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:34.273874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:55:34.331334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb4d80-c768-46c4-99a8-65b83129963c admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:34.335071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:34.335752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:34.336027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:34.336297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:34.345132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:34.346553 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:34.355831 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1334/2659] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:55:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:55:34.569892 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214bf49-eecf-4e01-ac99-a0f4cd248b0d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:55:34.579686 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214bf49-eecf-4e01-ac99-a0f4cd248b0d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:55:34.583308 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:55:34.583942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:55:34.584227 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:55:34.584499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:55:34.638925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:55:34.640356 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:55:34.649319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1326/2660] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:55:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:08.711946 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:08.713409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:08.770024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a04ed-7f31-4e7a-aa51-dd00990410af service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:08.773620 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a00880-b8cc-4d76-bb68-2ef01285019d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:08.774242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00880-b8cc-4d76-bb68-2ef01285019d service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:08.774528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00880-b8cc-4d76-bb68-2ef01285019d service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:08.774804 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00880-b8cc-4d76-bb68-2ef01285019d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:08.776586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f6a00880-b8cc-4d76-bb68-2ef01285019d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:08.844289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a00880-b8cc-4d76-bb68-2ef01285019d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:08.845765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a00880-b8cc-4d76-bb68-2ef01285019d service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:08.856618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1335/2661] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:17.869129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:17.871039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:17.883196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83b15a-d3c3-4dfb-b9d4-f2e148041147 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:17.886870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a428a5-97b4-4886-80cf-88f8d365e7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:17.887498 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a428a5-97b4-4886-80cf-88f8d365e7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:17.887780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a428a5-97b4-4886-80cf-88f8d365e7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:17.888058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a428a5-97b4-4886-80cf-88f8d365e7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:17.889820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f2a428a5-97b4-4886-80cf-88f8d365e7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:17.899145 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a428a5-97b4-4886-80cf-88f8d365e7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:17.900604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a428a5-97b4-4886-80cf-88f8d365e7c5 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:17.908465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1327/2662] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:24.591881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe07b-61f3-40f1-93e5-88c9815a52cd None None] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:24.592492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe07b-61f3-40f1-93e5-88c9815a52cd None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:24.592492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbe07b-61f3-40f1-93e5-88c9815a52cd None None] PATH_INFO: `/` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:24.594178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1336/2663] 10.222.0.21 () {54 vars in 921 bytes} [Mon Jan 31 04:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:56:24.601176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1b91-08a9-42ef-b57e-5b1b3faaa74a None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:24.601670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1b91-08a9-42ef-b57e-5b1b3faaa74a None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:24.601782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc1b91-08a9-42ef-b57e-5b1b3faaa74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:24.641254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-e8dc1b91-08a9-42ef-b57e-5b1b3faaa74a None None] MFA Rules not processed for user `889a6422677047b6a75d1480f156ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:24.642449 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e8dc1b91-08a9-42ef-b57e-5b1b3faaa74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:24.649463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1328/2664] 10.222.0.21 () {58 vars in 1018 bytes} [Mon Jan 31 04:56:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:24.664314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe07b-61f3-40f1-93e5-88c9815a52cd None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:24.673008 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbe07b-61f3-40f1-93e5-88c9815a52cd None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:24.677271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d29e6b-07f4-499b-841f-b826a70513e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:24.677889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29e6b-07f4-499b-841f-b826a70513e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:24.678164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29e6b-07f4-499b-841f-b826a70513e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:24.678433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29e6b-07f4-499b-841f-b826a70513e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:24.685393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d29e6b-07f4-499b-841f-b826a70513e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:24.687249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d29e6b-07f4-499b-841f-b826a70513e4 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:24.694726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1337/2665] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:24.788938 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a8096-28e9-4515-9c77-6cd873c7f53b None None] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:24.789230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a8096-28e9-4515-9c77-6cd873c7f53b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:24.789507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a8096-28e9-4515-9c77-6cd873c7f53b None None] PATH_INFO: `/` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:24.791362 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1329/2666] 10.222.0.21 () {54 vars in 960 bytes} [Mon Jan 31 04:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 31 04:56:24.796451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde859b2-463c-4e7a-92b0-0f7362710ac7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:24.796805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde859b2-463c-4e7a-92b0-0f7362710ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:24.797084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde859b2-463c-4e7a-92b0-0f7362710ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:24.834376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-cde859b2-463c-4e7a-92b0-0f7362710ac7 None None] MFA Rules not processed for user `266e2e8a599a4348aa356c18e3d7f3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:24.835600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-cde859b2-463c-4e7a-92b0-0f7362710ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:24.896592 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1338/2667] 10.222.0.21 () {58 vars in 1057 bytes} [Mon Jan 31 04:56:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:24.904265 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a8096-28e9-4515-9c77-6cd873c7f53b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:24.917509 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a8096-28e9-4515-9c77-6cd873c7f53b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:24.922338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832aeb58-14ba-4ab1-8027-81bc4411dd00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:24.922987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aeb58-14ba-4ab1-8027-81bc4411dd00 service placement] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:24.923269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aeb58-14ba-4ab1-8027-81bc4411dd00 service placement] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:24.923539 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aeb58-14ba-4ab1-8027-81bc4411dd00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:24.925501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-832aeb58-14ba-4ab1-8027-81bc4411dd00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:24.936907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832aeb58-14ba-4ab1-8027-81bc4411dd00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:24.938470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832aeb58-14ba-4ab1-8027-81bc4411dd00 service placement] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:24.948676 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1330/2668] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:27.155053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde859b2-463c-4e7a-92b0-0f7362710ac7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:27.215025 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde859b2-463c-4e7a-92b0-0f7362710ac7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:27.219445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:27.220287 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:27.220566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:27.220839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] PATH_INFO: `/v3/users/81dc0d2675174c129651d9993c12cb55` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:27.222681 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dc0d2675174c129651d9993c12cb55)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:27.224617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:27.401457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dc0d2675174c129651d9993c12cb55'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:27.402161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dc0d2675174c129651d9993c12cb55'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:27.415255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dc0d2675174c129651d9993c12cb55'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:27.421851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dc0d2675174c129651d9993c12cb55'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:27.483297 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dc0d2675174c129651d9993c12cb55'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:27.491206 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1339/2669] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:56:27 2022] DELETE /identity/v3/users/81dc0d2675174c129651d9993c12cb55 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:27.496007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:27.496485 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:27.496600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:27.514548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:27.515779 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:27.576510 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1331/2670] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:56:27.586646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:27.589987 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:27.647261 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1771a4-f3e8-4983-b81e-e2d018ace58d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:27.651320 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:27.652019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:27.652249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:27.652523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:27.662534 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:27.664013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:27.673924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1340/2671] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:28.172328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:28.173804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:28.186559 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71ec00-f37d-40e8-a108-cd55c13c2031 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:28.191628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:28.192683 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:28.192964 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:28.193233 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] PATH_INFO: `/v3/projects/7286100e68ba4530bbcfeeff780527ec` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:28.195493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7286100e68ba4530bbcfeeff780527ec)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:28.197402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:28.290171 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7286100e68ba4530bbcfeeff780527ec', 'request_id': 'req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.341827 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7286100e68ba4530bbcfeeff780527ec', 'request_id': 'req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.348818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7286100e68ba4530bbcfeeff780527ec', 'request_id': 'req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.358906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] The token cache is being invalidate because project 7286100e68ba4530bbcfeeff780527ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:56:28.359190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.359805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.361316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1332/2672] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:56:28 2022] DELETE /identity/v3/projects/7286100e68ba4530bbcfeeff780527ec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:28.366072 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:28.376161 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24a9c4-7066-479b-ad0b-a7bbcc86d966 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:28.560542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:28.561392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:28.561664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:28.561933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] PATH_INFO: `/v3/users/42d6c5b5ab7b453cb4e5a707ed90cf1c` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:28.563156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d6c5b5ab7b453cb4e5a707ed90cf1c)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:28.565020 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:28.726955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d6c5b5ab7b453cb4e5a707ed90cf1c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.727526 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d6c5b5ab7b453cb4e5a707ed90cf1c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.740187 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d6c5b5ab7b453cb4e5a707ed90cf1c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.747013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d6c5b5ab7b453cb4e5a707ed90cf1c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.878930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-4be2363e-52c9-4890-a817-5283c0cc0726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d6c5b5ab7b453cb4e5a707ed90cf1c'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:28.884926 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1341/2673] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:56:28 2022] DELETE /identity/v3/users/42d6c5b5ab7b453cb4e5a707ed90cf1c => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:29.245818 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:29.247384 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:29.261793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b21034-4a0e-4c24-9cb3-0e6cf9839211 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:29.327804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:29.328687 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:29.328975 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:29.329252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] PATH_INFO: `/v3/projects/18c76e19076943b5966c676c15b1661e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:29.330493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c76e19076943b5966c676c15b1661e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:29.333252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:29.490026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c76e19076943b5966c676c15b1661e', 'request_id': 'req-84e3e72b-3608-42f3-8261-185e294ecf73'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:29.564563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c76e19076943b5966c676c15b1661e', 'request_id': 'req-84e3e72b-3608-42f3-8261-185e294ecf73'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:29.571834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c76e19076943b5966c676c15b1661e', 'request_id': 'req-84e3e72b-3608-42f3-8261-185e294ecf73'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:29.582266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] The token cache is being invalidate because project 18c76e19076943b5966c676c15b1661e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:56:29.582555 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:29.583229 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-84e3e72b-3608-42f3-8261-185e294ecf73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:29.584768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1333/2674] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:56:29 2022] DELETE /identity/v3/projects/18c76e19076943b5966c676c15b1661e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:29.590415 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f9fec-4c99-49b1-b163-48dd1fc534b5 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:29.590948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f9fec-4c99-49b1-b163-48dd1fc534b5 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:29.591050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f9fec-4c99-49b1-b163-48dd1fc534b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:29.608429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-897f9fec-4c99-49b1-b163-48dd1fc534b5 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:29.609590 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-897f9fec-4c99-49b1-b163-48dd1fc534b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:29.665782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1342/2675] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:56:29.674620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af56787-31dc-4f9a-b346-0d6e5a176733 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:29.674973 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af56787-31dc-4f9a-b346-0d6e5a176733 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:29.676238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af56787-31dc-4f9a-b346-0d6e5a176733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:29.695062 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-9af56787-31dc-4f9a-b346-0d6e5a176733 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:29.696249 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9af56787-31dc-4f9a-b346-0d6e5a176733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:29.704079 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1334/2676] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:29.708444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f9fec-4c99-49b1-b163-48dd1fc534b5 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:29.717722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f9fec-4c99-49b1-b163-48dd1fc534b5 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:29.722242 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:29.722904 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:29.723179 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:29.723445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:29.724160 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:56:29.724453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:29.726017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:29.736838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1343/2677] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:56:29.741774 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af56787-31dc-4f9a-b346-0d6e5a176733 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:29.751163 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af56787-31dc-4f9a-b346-0d6e5a176733 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:29.756433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:29.757064 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:29.757348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:29.757653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:29.758347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:29.760276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:29.844579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1335/2678] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:56:29 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:29.848699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:29.858378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7b7a9-e0ef-408a-b485-cda75e3baa26 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:29.912469 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:29.913126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:29.913403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:29.913668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:29.914433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:29.916339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:29.987246 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1344/2679] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:56:29 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:56:29.992212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:30.002576 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb81d36-5593-4d60-8edf-5b0a49fa7e1c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:30.007300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:30.007942 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:30.010482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:30.010482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:30.010482 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:30.010814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:30.021021 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1336/2680] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:30.025033 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:30.035334 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95f8d1-c833-4860-b123-15c72f7170a8 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:30.039777 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee865f5-4184-486c-aefe-962c06774066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:30.040405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee865f5-4184-486c-aefe-962c06774066 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:30.040679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee865f5-4184-486c-aefe-962c06774066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:30.040944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee865f5-4184-486c-aefe-962c06774066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:30.041660 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee865f5-4184-486c-aefe-962c06774066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:30.043249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee865f5-4184-486c-aefe-962c06774066 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:30.053335 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1345/2681] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:30.057194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:30.067777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4307f-5a0a-422a-a0b8-fda06f6f0109 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:30.073744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:30.074617 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:30.074930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:30.075200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] PATH_INFO: `/v3/projects/9862806922ba4194a8b82f2c4d16ca00/users/50a8a670c5dc4001bcda9eb6d2adddcc/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:30.092777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9862806922ba4194a8b82f2c4d16ca00, user_id=50a8a670c5dc4001bcda9eb6d2adddcc, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:30.094074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:30.176234 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1337/2682] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:30 2022] PUT /identity/v3/projects/9862806922ba4194a8b82f2c4d16ca00/users/50a8a670c5dc4001bcda9eb6d2adddcc/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:56:30.186668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:30.186963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:30.187237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:30.213786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] MFA Rules not processed for user `50a8a670c5dc4001bcda9eb6d2adddcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:30.215013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:30.275359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1346/2683] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:30.284534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:30.286188 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:30.340725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede485-8efa-4af5-b52e-211581e57a62 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:30.344503 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:30.345144 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:30.345426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:30.345701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:30.354431 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:30.355908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:30.365232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1338/2684] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:38.043318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:38.044761 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:38.057289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1241-8dc7-460a-8756-55cbc5b856ce None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:38.060840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193295-c889-42e7-a1df-9fb10f6f9339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:38.061470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193295-c889-42e7-a1df-9fb10f6f9339 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:38.061748 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193295-c889-42e7-a1df-9fb10f6f9339 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:38.062019 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193295-c889-42e7-a1df-9fb10f6f9339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:38.063890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b4193295-c889-42e7-a1df-9fb10f6f9339 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:38.144993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193295-c889-42e7-a1df-9fb10f6f9339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:38.146704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193295-c889-42e7-a1df-9fb10f6f9339 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:38.165645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1347/2685] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:41.222987 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:41.282528 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba7bc3-350e-491e-a83e-e761431e99ff service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:41.287196 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:41.288086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:41.288342 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:41.288611 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] PATH_INFO: `/v3/users/50a8a670c5dc4001bcda9eb6d2adddcc` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:41.289786 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a8a670c5dc4001bcda9eb6d2adddcc)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:41.291751 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:41.486891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a8a670c5dc4001bcda9eb6d2adddcc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:41.547813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a8a670c5dc4001bcda9eb6d2adddcc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:41.548430 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a8a670c5dc4001bcda9eb6d2adddcc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:41.549029 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a8a670c5dc4001bcda9eb6d2adddcc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:41.557238 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a8a670c5dc4001bcda9eb6d2adddcc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:41.574654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1339/2686] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:56:41 2022] DELETE /identity/v3/users/50a8a670c5dc4001bcda9eb6d2adddcc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:56:41.579375 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:41.579791 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:41.579961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:41.598559 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:41.600148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:41.641327 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:41.643565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:41.661561 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1348/2687] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:41.671501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:41.676431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:41.753453 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711372b-8d68-44fe-b07f-df1dd00a0f54 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:41.753631 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351c7ae-7d00-4fa4-93f6-d74777b69dbc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:41.753754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:41.753754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:41.754241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:41.754606 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:41.755199 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5850f6c-a257-4f86-9d98-e5cd3d3e9df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:41.756116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5850f6c-a257-4f86-9d98-e5cd3d3e9df9 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:41.756582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5850f6c-a257-4f86-9d98-e5cd3d3e9df9 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:41.757025 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5850f6c-a257-4f86-9d98-e5cd3d3e9df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:41.759166 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e5850f6c-a257-4f86-9d98-e5cd3d3e9df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:41.766867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:41.770030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:41.776853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5850f6c-a257-4f86-9d98-e5cd3d3e9df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:41.778506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5850f6c-a257-4f86-9d98-e5cd3d3e9df9 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:41.781157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1349/2688] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:56:41.793026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1340/2689] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:42.252420 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:42.262668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:42.269641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29fc7a-a2cf-4fb4-abba-b39e8c5e1236 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:42.274976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:42.276153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:42.276588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:42.277013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] PATH_INFO: `/v3/projects/9862806922ba4194a8b82f2c4d16ca00` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:42.278379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9862806922ba4194a8b82f2c4d16ca00)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:42.280762 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:42.445884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9862806922ba4194a8b82f2c4d16ca00', 'request_id': 'req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:42.453044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9862806922ba4194a8b82f2c4d16ca00', 'request_id': 'req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:42.535354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9862806922ba4194a8b82f2c4d16ca00', 'request_id': 'req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:42.546979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] The token cache is being invalidate because project 9862806922ba4194a8b82f2c4d16ca00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:56:42.547398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:42.548053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-d94fee99-1c0f-4e28-aaf7-bca55661b2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:42.549670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1350/2690] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:56:42 2022] DELETE /identity/v3/projects/9862806922ba4194a8b82f2c4d16ca00 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:42.555947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297963c-e183-4f28-bfa0-20111a7e664d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:42.556882 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297963c-e183-4f28-bfa0-20111a7e664d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:42.557168 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297963c-e183-4f28-bfa0-20111a7e664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:42.575506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-8297963c-e183-4f28-bfa0-20111a7e664d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:42.576799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8297963c-e183-4f28-bfa0-20111a7e664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:42.638019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1341/2691] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:56:42.651355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069eb3-b7ec-489d-9ac3-29df1e54b8b7 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:42.653808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069eb3-b7ec-489d-9ac3-29df1e54b8b7 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:42.653808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86069eb3-b7ec-489d-9ac3-29df1e54b8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:42.672341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-86069eb3-b7ec-489d-9ac3-29df1e54b8b7 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:42.673882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-86069eb3-b7ec-489d-9ac3-29df1e54b8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:42.687654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1351/2692] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:42.692908 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297963c-e183-4f28-bfa0-20111a7e664d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:42.704870 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297963c-e183-4f28-bfa0-20111a7e664d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:42.712240 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:42.713217 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:42.713499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:42.713771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:42.714511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:56:42.714877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:42.716438 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:42.729764 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1342/2693] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:56:42.734158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86069eb3-b7ec-489d-9ac3-29df1e54b8b7 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:42.743835 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86069eb3-b7ec-489d-9ac3-29df1e54b8b7 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:42.748814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:42.751688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:42.751688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:42.751688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:42.751688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:42.753431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:42.891942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1352/2694] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:56:42 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:56:42.896812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:42.906477 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ffcae-9b00-4de8-8c9b-86ba0cbd3ecb admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:42.964767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:42.965439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:42.965720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:42.965996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:42.966714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:42.968681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:43.176793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1343/2695] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:56:42 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:56:43.180872 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:43.191495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bae5bf-0f9f-4e58-8893-114b782499ea admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:43.196065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:43.196702 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:43.196975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:43.197244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:43.198000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:43.199601 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:43.209582 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1353/2696] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:43.213548 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:43.223553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa147c-6bf3-4081-95b9-83a572f3d257 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:43.228342 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1262b-ede7-472c-89fd-9f88fad37b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:43.228983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1262b-ede7-472c-89fd-9f88fad37b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:43.229261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1262b-ede7-472c-89fd-9f88fad37b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:43.229532 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1262b-ede7-472c-89fd-9f88fad37b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:43.230252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1262b-ede7-472c-89fd-9f88fad37b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:43.231847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1262b-ede7-472c-89fd-9f88fad37b50 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:43.241907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1344/2697] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:43.246175 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:43.256410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40511-da82-46f0-87a2-cffab948ccaf admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:43.260844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:43.261690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:43.261968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:43.262238 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] PATH_INFO: `/v3/projects/0ddf03e3a1c442b58157d3018d2cd604/users/6556dcdf517e4615ac5d2d68410e38ee/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:43.275980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddf03e3a1c442b58157d3018d2cd604, user_id=6556dcdf517e4615ac5d2d68410e38ee, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:43.278612 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:43.364275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1354/2698] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:43 2022] PUT /identity/v3/projects/0ddf03e3a1c442b58157d3018d2cd604/users/6556dcdf517e4615ac5d2d68410e38ee/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:43.375658 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:43.375950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:43.376225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:43.405303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] MFA Rules not processed for user `6556dcdf517e4615ac5d2d68410e38ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:43.406565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:43.480435 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1345/2699] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:43.491399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:43.507569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:43.561583 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19328d0-ac31-4c1d-8f21-54e9e5d62642 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:43.565133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:43.566325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:43.566614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:43.566911 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:43.581555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:43.581555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:43.585874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1355/2700] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:46.904716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:46.906230 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:46.962251 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e5179-34d5-4448-9b98-ed3f65abc9d9 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:46.966186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3816de3-15ee-4c54-a75d-906ccf1d317e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:46.966534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3816de3-15ee-4c54-a75d-906ccf1d317e service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:46.966836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3816de3-15ee-4c54-a75d-906ccf1d317e service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:46.967115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3816de3-15ee-4c54-a75d-906ccf1d317e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:46.968852 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b3816de3-15ee-4c54-a75d-906ccf1d317e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:47.031042 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3816de3-15ee-4c54-a75d-906ccf1d317e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:47.032461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3816de3-15ee-4c54-a75d-906ccf1d317e service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:47.042567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1346/2701] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:47.588424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:47.599190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea2e87-6bb8-4e02-b9af-408c79acc532 service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:47.603661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:47.604515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:47.604793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:47.605065 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] PATH_INFO: `/v3/users/6556dcdf517e4615ac5d2d68410e38ee` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:47.606251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=6556dcdf517e4615ac5d2d68410e38ee)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:47.608178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:47.814782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6556dcdf517e4615ac5d2d68410e38ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:47.815498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6556dcdf517e4615ac5d2d68410e38ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:47.828996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6556dcdf517e4615ac5d2d68410e38ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:47.835720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6556dcdf517e4615ac5d2d68410e38ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:47.930193 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6556dcdf517e4615ac5d2d68410e38ee'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:47.936528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1356/2702] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:56:47 2022] DELETE /identity/v3/users/6556dcdf517e4615ac5d2d68410e38ee => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:47.941149 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:47.941701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:47.941891 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:47.959187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:47.960395 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:48.025578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1347/2703] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:48.036122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:48.037536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:48.107743 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fc363-1c97-4eb0-8afa-df77c022b4af admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:48.111608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736893cd-8185-4471-95aa-ac5b8c029418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:48.112263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736893cd-8185-4471-95aa-ac5b8c029418 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:48.112576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736893cd-8185-4471-95aa-ac5b8c029418 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:48.113379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736893cd-8185-4471-95aa-ac5b8c029418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:48.123545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736893cd-8185-4471-95aa-ac5b8c029418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:48.125038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736893cd-8185-4471-95aa-ac5b8c029418 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:48.137292 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1357/2704] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:48.911253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:48.916070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:48.924736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ae1fd-a54e-400d-bafb-9b9cc0b5eb4e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:48.930639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:48.931513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:48.931762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:48.932031 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] PATH_INFO: `/v3/projects/0ddf03e3a1c442b58157d3018d2cd604` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:48.933787 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddf03e3a1c442b58157d3018d2cd604)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:48.935348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:49.043041 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddf03e3a1c442b58157d3018d2cd604', 'request_id': 'req-bd43df79-4ebf-4922-8393-51753b65cbfc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:49.136336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddf03e3a1c442b58157d3018d2cd604', 'request_id': 'req-bd43df79-4ebf-4922-8393-51753b65cbfc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:49.144566 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddf03e3a1c442b58157d3018d2cd604', 'request_id': 'req-bd43df79-4ebf-4922-8393-51753b65cbfc'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:49.156236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] The token cache is being invalidate because project 0ddf03e3a1c442b58157d3018d2cd604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:56:49.156883 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:49.157292 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bd43df79-4ebf-4922-8393-51753b65cbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:49.159307 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1348/2705] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:56:48 2022] DELETE /identity/v3/projects/0ddf03e3a1c442b58157d3018d2cd604 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:49.167278 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099efd-e27b-4ece-8981-7b145039490e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.167754 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099efd-e27b-4ece-8981-7b145039490e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.167838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099efd-e27b-4ece-8981-7b145039490e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.185613 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-78099efd-e27b-4ece-8981-7b145039490e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:49.186654 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-78099efd-e27b-4ece-8981-7b145039490e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:49.250524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1358/2706] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:49.258685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254302-ad38-43c6-83bc-0a1f70c3c457 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.258995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254302-ad38-43c6-83bc-0a1f70c3c457 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.259268 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254302-ad38-43c6-83bc-0a1f70c3c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.278311 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f6254302-ad38-43c6-83bc-0a1f70c3c457 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:49.279543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f6254302-ad38-43c6-83bc-0a1f70c3c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:49.288640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1349/2707] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:56:49.292866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099efd-e27b-4ece-8981-7b145039490e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:49.302848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099efd-e27b-4ece-8981-7b145039490e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:49.308176 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:49.308844 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.309122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.309393 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.310132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:56:49.310428 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:49.312053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:49.324456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1359/2708] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:56:49.328946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6254302-ad38-43c6-83bc-0a1f70c3c457 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:49.340907 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6254302-ad38-43c6-83bc-0a1f70c3c457 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:49.345744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:49.346561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.346895 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.348010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.349109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:49.351336 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:49.451357 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1350/2709] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:56:49 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:49.455609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:49.466542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb7ad-07ec-4fc2-8ca3-765e4bb48cf2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:49.523073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:49.524350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.524635 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.525668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.526565 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:49.528862 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:49.616593 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1360/2710] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:56:49 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:56:49.616811 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:49.621051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f6be0-54ef-472b-a783-3d4bd2946310 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:49.625623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:49.626269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.626547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.626848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.627578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:49.629183 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:49.640304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1351/2711] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:49.644579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:49.654507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce14954-408e-48f6-9dca-0c9666cccad2 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:49.659267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859a2d-fbca-4ccd-8037-4abd5be5d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:49.660622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859a2d-fbca-4ccd-8037-4abd5be5d708 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.660912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859a2d-fbca-4ccd-8037-4abd5be5d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.661180 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859a2d-fbca-4ccd-8037-4abd5be5d708 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.661947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9859a2d-fbca-4ccd-8037-4abd5be5d708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:49.665113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9859a2d-fbca-4ccd-8037-4abd5be5d708 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:49.674832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1361/2712] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:49.679670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:49.692011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89eeae-3deb-4c56-a5e6-d2a09c6bed76 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:49.696997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:49.697971 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.698316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.698595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] PATH_INFO: `/v3/projects/8ca7da4f29174d1791bced97047d1a97/users/04965554412a4ea9a41ea208804ab69e/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.714624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca7da4f29174d1791bced97047d1a97, user_id=04965554412a4ea9a41ea208804ab69e, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:49.717406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:49.814279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1352/2713] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:49 2022] PUT /identity/v3/projects/8ca7da4f29174d1791bced97047d1a97/users/04965554412a4ea9a41ea208804ab69e/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:49.826412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.826704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.827015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:49.852867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] MFA Rules not processed for user `04965554412a4ea9a41ea208804ab69e`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:49.854166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:49.920569 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1362/2714] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:49.930310 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:49.932083 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:49.986855 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6662cf0-629b-490f-b157-74d3d6e9dddc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:49.991857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:49.992493 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:49.992776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:49.993049 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:50.001656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:50.003178 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:50.012636 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1353/2715] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:50.907767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:50.909977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:50.976370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1f2cf-f844-4c0a-bc17-784f4473613d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:50.980955 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:50.981699 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:50.981975 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:50.982244 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] PATH_INFO: `/v3/users/aa68ebb7220c4e6383128947fc970877` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:50.983571 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa68ebb7220c4e6383128947fc970877)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:50.985618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:51.166647 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa68ebb7220c4e6383128947fc970877'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.167384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa68ebb7220c4e6383128947fc970877'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.178891 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa68ebb7220c4e6383128947fc970877'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.185435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa68ebb7220c4e6383128947fc970877'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.265350 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-031b460b-ccbc-47f6-9859-61c1beec4856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa68ebb7220c4e6383128947fc970877'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.272184 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1363/2716] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:56:50 2022] DELETE /identity/v3/users/aa68ebb7220c4e6383128947fc970877 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:51.512804 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:51.525076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70b4fa-a629-4313-b103-587670cf5dcb service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:51.580886 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:51.581773 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:51.582038 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:51.582312 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] PATH_INFO: `/v3/projects/3951fb700ad04745afa04a4b077da951` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:51.583550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3951fb700ad04745afa04a4b077da951)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:51.585444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:51.710151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3951fb700ad04745afa04a4b077da951', 'request_id': 'req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.819990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3951fb700ad04745afa04a4b077da951', 'request_id': 'req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.826861 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3951fb700ad04745afa04a4b077da951', 'request_id': 'req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.837402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] The token cache is being invalidate because project 3951fb700ad04745afa04a4b077da951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:56:51.837685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.838304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ad9d71bd-65ab-49ce-b731-3ac7cfc13342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:51.839839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1354/2717] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:56:51 2022] DELETE /identity/v3/projects/3951fb700ad04745afa04a4b077da951 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:56:51.845676 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4edea8-c15d-4321-8e23-426b9e159f3a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:51.845959 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4edea8-c15d-4321-8e23-426b9e159f3a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:51.851353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4edea8-c15d-4321-8e23-426b9e159f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:51.864695 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9a4edea8-c15d-4321-8e23-426b9e159f3a None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:51.865866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9a4edea8-c15d-4321-8e23-426b9e159f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:51.921704 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1364/2718] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:56:51.930530 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203d4d-cffb-4889-ae8a-482c05a053b2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:51.930846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203d4d-cffb-4889-ae8a-482c05a053b2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:51.931134 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6203d4d-cffb-4889-ae8a-482c05a053b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:51.949392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f6203d4d-cffb-4889-ae8a-482c05a053b2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:51.950583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f6203d4d-cffb-4889-ae8a-482c05a053b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:51.958757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1355/2719] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:51.963154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4edea8-c15d-4321-8e23-426b9e159f3a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:51.973105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4edea8-c15d-4321-8e23-426b9e159f3a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:51.977617 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:51.978241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:51.978525 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:51.978779 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:51.979523 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:56:51.979817 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:51.981376 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:51.993198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1365/2720] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:56:51.997652 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6203d4d-cffb-4889-ae8a-482c05a053b2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.007106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6203d4d-cffb-4889-ae8a-482c05a053b2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.011810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.016983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.016983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.016983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.016983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.016983 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.091623 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1356/2721] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:56:51 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:52.095719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.106812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc8bff-d37f-4b73-b807-8b288e29f226 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.162731 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.163446 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.163726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.164001 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.164700 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.166594 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.277471 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1366/2722] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:56:52 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:56:52.281677 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.293056 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368a57-cf78-4bfe-8fd2-a9a284c31fd9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.297688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.298341 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.298620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.298939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.299678 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.301640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.311814 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1357/2723] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:52.315641 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.325482 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007f7d-0b55-4c52-91c6-884280fd11de admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.330013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407bec8-996a-443a-8a79-556badbf508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.330651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bec8-996a-443a-8a79-556badbf508f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.330968 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bec8-996a-443a-8a79-556badbf508f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.332038 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bec8-996a-443a-8a79-556badbf508f admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.332953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407bec8-996a-443a-8a79-556badbf508f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.334546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407bec8-996a-443a-8a79-556badbf508f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.344070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1367/2724] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:52.348508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.358116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5a86-7f65-4c5f-87ce-8fefce4a5779 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.362668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.363567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.363850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.364127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] PATH_INFO: `/v3/projects/b5919f8b8c8e4f6bb0569dc540a8a593/users/82fb38ccf1c54e66865f9586631950f0/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.378495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5919f8b8c8e4f6bb0569dc540a8a593, user_id=82fb38ccf1c54e66865f9586631950f0, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.381204 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.477024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1358/2725] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:52 2022] PUT /identity/v3/projects/b5919f8b8c8e4f6bb0569dc540a8a593/users/82fb38ccf1c54e66865f9586631950f0/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:52.488429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc58b6-9121-4e55-aa4d-e1ccc3b8be6b None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.488716 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc58b6-9121-4e55-aa4d-e1ccc3b8be6b None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.488991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc58b6-9121-4e55-aa4d-e1ccc3b8be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.515473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-70fc58b6-9121-4e55-aa4d-e1ccc3b8be6b None None] MFA Rules not processed for user `82fb38ccf1c54e66865f9586631950f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:52.516650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-70fc58b6-9121-4e55-aa4d-e1ccc3b8be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:52.577490 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1368/2726] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:52.582562 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.641414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb6dea-7ffb-465c-adcf-b56e142449c4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.646590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.647261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.647545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.647819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.648523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.650419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.729545 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1359/2727] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:56:52 2022] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:52.733524 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc58b6-9121-4e55-aa4d-e1ccc3b8be6b None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.743969 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc58b6-9121-4e55-aa4d-e1ccc3b8be6b None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.798336 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.799150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.799370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.799667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.800907 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.802928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.880197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1369/2728] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:56:52 2022] POST /identity/v3/users => generated 308 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:52.883967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.895417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a395f-8840-4678-b13e-dfff7fffcc10 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.899961 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.900611 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.900950 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.901228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.901955 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.903595 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:52.915246 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1360/2729] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:52.919568 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:52.929509 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d2bd4-beb4-4025-951e-2ff2ce9fd03e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:52.934775 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:52.935669 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:52.935944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:52.936212 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] PATH_INFO: `/v3/projects/95b988d41c264b36a97730a658ef85f7/users/336ed5e470be472389987e208c26e298/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:52.950694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b988d41c264b36a97730a658ef85f7, user_id=336ed5e470be472389987e208c26e298, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:52.953349 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:53.054148 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1370/2730] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:52 2022] PUT /identity/v3/projects/95b988d41c264b36a97730a658ef85f7/users/336ed5e470be472389987e208c26e298/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:53.058110 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:53.068496 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fb27c-7f0b-4779-b457-acab4f7b154b admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:53.124736 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1776b46-4dca-423b-a353-78aa394f8811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:53.125390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776b46-4dca-423b-a353-78aa394f8811 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:53.125670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776b46-4dca-423b-a353-78aa394f8811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:53.125943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776b46-4dca-423b-a353-78aa394f8811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:53.126670 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1776b46-4dca-423b-a353-78aa394f8811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:53.128348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1776b46-4dca-423b-a353-78aa394f8811 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:53.137881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1361/2731] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:53.141980 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:53.153114 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbce6e2-f6ec-4d12-a338-b2ee74606762 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:53.157786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:53.158645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:53.158965 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:53.159840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] PATH_INFO: `/v3/projects/95b988d41c264b36a97730a658ef85f7/users/336ed5e470be472389987e208c26e298/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:53.162152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b988d41c264b36a97730a658ef85f7, user_id=336ed5e470be472389987e208c26e298, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:53.164834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:53.174691 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1371/2732] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:53 2022] PUT /identity/v3/projects/95b988d41c264b36a97730a658ef85f7/users/336ed5e470be472389987e208c26e298/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:53.186269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d397b-9c18-46d0-af72-90e334b5c043 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:53.186560 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d397b-9c18-46d0-af72-90e334b5c043 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:53.186872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d397b-9c18-46d0-af72-90e334b5c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:53.214771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-bf9d397b-9c18-46d0-af72-90e334b5c043 None None] MFA Rules not processed for user `336ed5e470be472389987e208c26e298`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:53.215355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bf9d397b-9c18-46d0-af72-90e334b5c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:53.281669 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1362/2733] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:56:53.291595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:53.293392 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:53.350285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bfcbf-9ea7-4525-9220-e0ef0c1dabc9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:53.353921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8d4f3-bbc5-4128-a3ad-ac30f2690605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:53.358027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8d4f3-bbc5-4128-a3ad-ac30f2690605 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:53.358027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8d4f3-bbc5-4128-a3ad-ac30f2690605 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:53.358027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8d4f3-bbc5-4128-a3ad-ac30f2690605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:53.364465 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8d4f3-bbc5-4128-a3ad-ac30f2690605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:53.365882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8d4f3-bbc5-4128-a3ad-ac30f2690605 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:53.375720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1372/2734] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:53.522405 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d397b-9c18-46d0-af72-90e334b5c043 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:53.582303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d397b-9c18-46d0-af72-90e334b5c043 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:53.586972 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:53.587821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:53.588103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:53.588380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] PATH_INFO: `/v3/users/82fb38ccf1c54e66865f9586631950f0` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:53.589577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82fb38ccf1c54e66865f9586631950f0)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:53.591569 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:53.764252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82fb38ccf1c54e66865f9586631950f0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:53.848805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82fb38ccf1c54e66865f9586631950f0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:53.849427 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82fb38ccf1c54e66865f9586631950f0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:53.850070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82fb38ccf1c54e66865f9586631950f0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:53.857257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82fb38ccf1c54e66865f9586631950f0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:53.874388 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1363/2735] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:56:53 2022] DELETE /identity/v3/users/82fb38ccf1c54e66865f9586631950f0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:53.879069 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:53.879360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:53.879638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:53.897696 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:53.898961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:53.955912 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1373/2736] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:53.965968 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:53.967437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:54.022368 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156910f-beed-4e57-aa66-6659dabd28d1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:54.025869 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:54.026490 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:54.026768 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:54.027072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:54.035925 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:54.037329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:54.046346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1364/2737] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:54.438768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:54.440218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:54.458026 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a79b1-de6f-4d6c-87b3-d3a8814cf507 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:54.463003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:54.463874 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:54.464158 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:54.464431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] PATH_INFO: `/v3/projects/b5919f8b8c8e4f6bb0569dc540a8a593` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:54.465725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5919f8b8c8e4f6bb0569dc540a8a593)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:54.467738 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:54.609948 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5919f8b8c8e4f6bb0569dc540a8a593', 'request_id': 'req-af602d45-c2cc-4407-8873-0d3c054b63ac'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:54.615707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5919f8b8c8e4f6bb0569dc540a8a593', 'request_id': 'req-af602d45-c2cc-4407-8873-0d3c054b63ac'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:54.716536 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5919f8b8c8e4f6bb0569dc540a8a593', 'request_id': 'req-af602d45-c2cc-4407-8873-0d3c054b63ac'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:54.727930 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] The token cache is being invalidate because project b5919f8b8c8e4f6bb0569dc540a8a593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:56:54.728209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:54.728824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:54.730325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1374/2738] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:56:54 2022] DELETE /identity/v3/projects/b5919f8b8c8e4f6bb0569dc540a8a593 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:54.734517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:54.749177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b309-2815-4840-9a46-96f910feb799 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:54.799326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:54.800322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:54.800620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:54.800893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] PATH_INFO: `/v3/users/336ed5e470be472389987e208c26e298` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:54.802092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336ed5e470be472389987e208c26e298)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:54.804027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:54.999136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336ed5e470be472389987e208c26e298'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.071392 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336ed5e470be472389987e208c26e298'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.072232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336ed5e470be472389987e208c26e298'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.072854 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336ed5e470be472389987e208c26e298'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.080609 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-7159c33c-b551-486e-bf98-dcd340391573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336ed5e470be472389987e208c26e298'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.104586 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1365/2739] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:56:54 2022] DELETE /identity/v3/users/336ed5e470be472389987e208c26e298 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:55.486029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:55.491488 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:55.502528 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af602d45-c2cc-4407-8873-0d3c054b63ac admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:55.559648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:55.560493 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:55.560766 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:55.561034 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] PATH_INFO: `/v3/projects/95b988d41c264b36a97730a658ef85f7` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:55.562198 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b988d41c264b36a97730a658ef85f7)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:55.564129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:55.722403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b988d41c264b36a97730a658ef85f7', 'request_id': 'req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.727659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b988d41c264b36a97730a658ef85f7', 'request_id': 'req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.792634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b988d41c264b36a97730a658ef85f7', 'request_id': 'req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.804438 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] The token cache is being invalidate because project 95b988d41c264b36a97730a658ef85f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:56:55.804722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.805329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5aca2ba4-9cf5-4a6d-8146-83a4e3e25d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:56:55.806846 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1375/2740] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:56:55 2022] DELETE /identity/v3/projects/95b988d41c264b36a97730a658ef85f7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:56:55.812522 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9b052-5336-4b6e-bb32-2ae9cd4b779e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:55.813007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9b052-5336-4b6e-bb32-2ae9cd4b779e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:55.813102 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9b052-5336-4b6e-bb32-2ae9cd4b779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:55.831848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-54a9b052-5336-4b6e-bb32-2ae9cd4b779e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:55.833057 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-54a9b052-5336-4b6e-bb32-2ae9cd4b779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:55.891280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1366/2741] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:55.899328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945222-900b-40d1-ab58-5e86123421d6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:55.899618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945222-900b-40d1-ab58-5e86123421d6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:55.899893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945222-900b-40d1-ab58-5e86123421d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:55.917529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d9945222-900b-40d1-ab58-5e86123421d6 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:55.918698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d9945222-900b-40d1-ab58-5e86123421d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:55.927122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1376/2742] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:55.931253 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9b052-5336-4b6e-bb32-2ae9cd4b779e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:55.941236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9b052-5336-4b6e-bb32-2ae9cd4b779e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:55.945783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:55.946417 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:55.946693 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:55.946994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:55.947720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:56:55.948020 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:55.949585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:55.960697 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1367/2743] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:56:55.964885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945222-900b-40d1-ab58-5e86123421d6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:55.974014 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945222-900b-40d1-ab58-5e86123421d6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:55.978602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:55.979285 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:55.979564 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:55.979833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:55.980565 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:55.982518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.119408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1377/2744] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:56:55 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:56.124107 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.135035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b5c5-3989-4a6e-a739-bf46b4d4aede admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.189956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.190761 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.191135 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.191511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.192250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.194160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.294050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1368/2745] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:56:56 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:56.298215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.309631 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528adfc-0336-4c79-91d6-ffec87e07419 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.314266 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.314942 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.315220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.315552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.316275 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.317833 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.328048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1378/2746] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:56.332918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.341838 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49358cc9-5596-4cd5-9dad-35d625fe0571 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.346443 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5266c8-72ee-44a6-bbdc-8eeca368d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.347632 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5266c8-72ee-44a6-bbdc-8eeca368d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.347913 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5266c8-72ee-44a6-bbdc-8eeca368d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.348180 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5266c8-72ee-44a6-bbdc-8eeca368d2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.348898 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5266c8-72ee-44a6-bbdc-8eeca368d2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.350582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5266c8-72ee-44a6-bbdc-8eeca368d2fd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.360113 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1369/2747] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:56:56.365218 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.375352 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e79c-ec85-4664-822f-3e86a7cf83f6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.380531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.381399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.381688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.381941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] PATH_INFO: `/v3/projects/126bee929cff4816851a1e7b16cccdec/users/f9a11ce951c342158352115125fb215e/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.396507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126bee929cff4816851a1e7b16cccdec, user_id=f9a11ce951c342158352115125fb215e, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.399174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.477042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1379/2748] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:56 2022] PUT /identity/v3/projects/126bee929cff4816851a1e7b16cccdec/users/f9a11ce951c342158352115125fb215e/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:56:56.488873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598703-67b2-4d1e-a644-1158501f605c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.489160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598703-67b2-4d1e-a644-1158501f605c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.489432 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598703-67b2-4d1e-a644-1158501f605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.515622 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-34598703-67b2-4d1e-a644-1158501f605c None None] MFA Rules not processed for user `f9a11ce951c342158352115125fb215e`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:56.516812 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-34598703-67b2-4d1e-a644-1158501f605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:56.579191 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1370/2749] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:56.584205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.642188 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba097e-b656-44f8-a8a5-d7a8a5268615 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.647281 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.647910 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.648185 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.648452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.649144 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.651044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.742636 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1380/2750] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:56:56 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:56:56.746785 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598703-67b2-4d1e-a644-1158501f605c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.757600 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598703-67b2-4d1e-a644-1158501f605c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.811534 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.812283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.812583 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.813151 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.813541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.815568 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.918934 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1371/2751] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:56:56 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:56:56.922812 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.933258 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca339f8-d70d-4a16-8af1-da8f71382af9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.937881 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.938522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.938816 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.939101 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.939829 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.942204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:56.952307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1381/2752] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:56.956830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:56.967360 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c453dde-be0f-41f0-b9d0-17d6e6da2dc3 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:56.972261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:56.973158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:56.973439 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:56.973716 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] PATH_INFO: `/v3/projects/e165c64716a04a47a9cb7d25942bd5e0/users/b98484a8617648aa981e074d8e6ad1d0/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:56.989414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e165c64716a04a47a9cb7d25942bd5e0, user_id=b98484a8617648aa981e074d8e6ad1d0, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:56.992105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:57.067682 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1372/2753] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:56 2022] PUT /identity/v3/projects/e165c64716a04a47a9cb7d25942bd5e0/users/b98484a8617648aa981e074d8e6ad1d0/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:57.071570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:57.082153 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1339df4-5cec-4ce2-9ed2-bf1ae997e0ec admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:57.137322 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d76830-8899-4a57-8d45-3e35baf2e16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:57.137986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76830-8899-4a57-8d45-3e35baf2e16b admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:57.138277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76830-8899-4a57-8d45-3e35baf2e16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:57.138537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76830-8899-4a57-8d45-3e35baf2e16b admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:57.139306 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76830-8899-4a57-8d45-3e35baf2e16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:57.140893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76830-8899-4a57-8d45-3e35baf2e16b admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:57.151156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1382/2754] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:56:57.155295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:57.165257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a297f-a9ec-4e0c-abf2-0bbc0ae758d8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:57.170702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:57.171757 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:57.172119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:57.172458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] PATH_INFO: `/v3/projects/e165c64716a04a47a9cb7d25942bd5e0/users/b98484a8617648aa981e074d8e6ad1d0/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:57.174494 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e165c64716a04a47a9cb7d25942bd5e0, user_id=b98484a8617648aa981e074d8e6ad1d0, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:57.177808 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:57.188679 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1373/2755] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:56:57 2022] PUT /identity/v3/projects/e165c64716a04a47a9cb7d25942bd5e0/users/b98484a8617648aa981e074d8e6ad1d0/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:56:57.200088 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5496b5-3805-413b-8b29-bef97bfcaa3a None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:57.200378 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5496b5-3805-413b-8b29-bef97bfcaa3a None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:57.200650 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5496b5-3805-413b-8b29-bef97bfcaa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:57.229774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-8c5496b5-3805-413b-8b29-bef97bfcaa3a None None] MFA Rules not processed for user `b98484a8617648aa981e074d8e6ad1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:56:57.231004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8c5496b5-3805-413b-8b29-bef97bfcaa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:57.296888 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1383/2756] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:56:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:56:57.308276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:57.309948 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:56:57.366086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0cfcc-c048-4b91-abac-f5ebe04ca695 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:57.370012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:57.370647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:57.370959 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:57.371231 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:57.380857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:57.382279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:57.391725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1374/2757] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:56:57.614102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5496b5-3805-413b-8b29-bef97bfcaa3a None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:56:57.623943 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5496b5-3805-413b-8b29-bef97bfcaa3a None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:56:57.627408 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430d1ea-0045-4393-8ef7-9fa1e7eedf45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:56:57.628714 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d1ea-0045-4393-8ef7-9fa1e7eedf45 service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:56:57.629129 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d1ea-0045-4393-8ef7-9fa1e7eedf45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:56:57.629402 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d1ea-0045-4393-8ef7-9fa1e7eedf45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:56:57.685384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430d1ea-0045-4393-8ef7-9fa1e7eedf45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:56:57.686871 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430d1ea-0045-4393-8ef7-9fa1e7eedf45 service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:56:57.696113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1384/2758] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:56:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:06.395805 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:06.397221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:06.466317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cbb10-188f-48fb-adc0-5438d10a26fe service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:06.466317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:06.467061 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:06.467346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:06.467621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] PATH_INFO: `/v3/users/04965554412a4ea9a41ea208804ab69e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:06.468820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04965554412a4ea9a41ea208804ab69e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:06.470714 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:06.704991 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04965554412a4ea9a41ea208804ab69e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:06.796418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04965554412a4ea9a41ea208804ab69e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:06.797030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04965554412a4ea9a41ea208804ab69e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:06.797645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04965554412a4ea9a41ea208804ab69e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:06.805075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04965554412a4ea9a41ea208804ab69e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:06.822680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1375/2759] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:06 2022] DELETE /identity/v3/users/04965554412a4ea9a41ea208804ab69e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:06.827296 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:06.827756 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:06.827882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:06.846671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:06.846671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:06.906518 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1385/2760] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:06.916853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:06.918242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:06.975674 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41357ab-4fbf-4090-a52c-d56f10abac60 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:06.981662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ae6a8-7d5c-41ad-af3d-fe84da0a9739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:06.981662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae6a8-7d5c-41ad-af3d-fe84da0a9739 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:06.981662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae6a8-7d5c-41ad-af3d-fe84da0a9739 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:06.981662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ae6a8-7d5c-41ad-af3d-fe84da0a9739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:06.990442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ae6a8-7d5c-41ad-af3d-fe84da0a9739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:06.991918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ae6a8-7d5c-41ad-af3d-fe84da0a9739 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:07.001918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1376/2761] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:07.421293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:07.423045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:07.435940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739d3fe-ca33-408d-bd99-253679ee4949 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:07.440840 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:07.441678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:07.442028 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:07.442307 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] PATH_INFO: `/v3/projects/8ca7da4f29174d1791bced97047d1a97` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:07.443529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca7da4f29174d1791bced97047d1a97)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:07.447228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:07.587007 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca7da4f29174d1791bced97047d1a97', 'request_id': 'req-33d11e0d-817b-487b-a35b-4c7417196282'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:07.592314 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca7da4f29174d1791bced97047d1a97', 'request_id': 'req-33d11e0d-817b-487b-a35b-4c7417196282'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:07.684086 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca7da4f29174d1791bced97047d1a97', 'request_id': 'req-33d11e0d-817b-487b-a35b-4c7417196282'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:07.695329 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] The token cache is being invalidate because project 8ca7da4f29174d1791bced97047d1a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:07.695611 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:07.696230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-33d11e0d-817b-487b-a35b-4c7417196282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:07.697743 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1386/2762] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:07 2022] DELETE /identity/v3/projects/8ca7da4f29174d1791bced97047d1a97 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:07.703620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13641e-f36b-4551-a3eb-76487e7e32e2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:07.704093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13641e-f36b-4551-a3eb-76487e7e32e2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:07.704232 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13641e-f36b-4551-a3eb-76487e7e32e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:07.722373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-dc13641e-f36b-4551-a3eb-76487e7e32e2 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:07.723582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-dc13641e-f36b-4551-a3eb-76487e7e32e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:07.780789 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1377/2763] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:07.789085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce745-a21f-4870-8005-812760864c83 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:07.789374 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce745-a21f-4870-8005-812760864c83 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:07.789783 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce745-a21f-4870-8005-812760864c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:07.807923 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-5f5ce745-a21f-4870-8005-812760864c83 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:07.809109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5f5ce745-a21f-4870-8005-812760864c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:07.817282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1387/2764] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:07.821628 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13641e-f36b-4551-a3eb-76487e7e32e2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:07.831640 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13641e-f36b-4551-a3eb-76487e7e32e2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:07.836299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:07.836930 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:07.837266 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:07.837484 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:07.838210 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:57:07.838511 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:07.840241 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:07.851502 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1378/2765] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:57:07.855709 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ce745-a21f-4870-8005-812760864c83 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:07.865418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ce745-a21f-4870-8005-812760864c83 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:07.870464 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:07.871146 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:07.871473 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:07.871746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:07.872448 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:07.874325 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:07.953572 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1388/2766] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:07 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:57:07.958293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:07.968037 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482528dc-6bf9-4223-8a37-26d349791aa2 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:08.023109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:08.023756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:08.024035 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:08.024304 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:08.025001 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:08.026906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:08.139466 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1379/2767] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:07 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:08.143712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:08.154145 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5760-a1c4-42c5-af49-1f7a19125c45 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:08.159229 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:08.159883 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:08.160157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:08.160430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:08.161189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:08.162822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:08.172803 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1389/2768] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:08.177297 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:08.187027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b614ff-3f10-4e0c-92ee-5e604b0eb418 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:08.191893 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3623ac-b568-45aa-a02b-34ae2d9b40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:08.192537 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3623ac-b568-45aa-a02b-34ae2d9b40dd admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:08.192821 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3623ac-b568-45aa-a02b-34ae2d9b40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:08.193101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3623ac-b568-45aa-a02b-34ae2d9b40dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:08.193864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3623ac-b568-45aa-a02b-34ae2d9b40dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:08.195476 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3623ac-b568-45aa-a02b-34ae2d9b40dd admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:08.204989 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1380/2769] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:08.209054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:08.218828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f2d0d-4ae1-4877-bd3d-66645cfe0940 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:08.224003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:08.224855 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:08.225128 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:08.225470 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] PATH_INFO: `/v3/projects/e1637f6e48094653bebf0bc7af9aab9a/users/02c59be1b62c4774a050047b4f5364d9/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:08.240282 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1637f6e48094653bebf0bc7af9aab9a, user_id=02c59be1b62c4774a050047b4f5364d9, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:08.243045 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:08.316797 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1390/2770] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:08 2022] PUT /identity/v3/projects/e1637f6e48094653bebf0bc7af9aab9a/users/02c59be1b62c4774a050047b4f5364d9/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:08.321798 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:08.322090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:08.322373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:08.340563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:08.341759 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:08.399766 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1381/2771] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:08.409316 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:08.411042 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:08.469231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e240b-6b82-4d6a-8b85-31ac3aa730bb admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:08.473085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a542c29-1b65-4f7e-91b4-03c3768e4143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:08.473722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542c29-1b65-4f7e-91b4-03c3768e4143 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:08.474002 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542c29-1b65-4f7e-91b4-03c3768e4143 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:08.474289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542c29-1b65-4f7e-91b4-03c3768e4143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:08.483533 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a542c29-1b65-4f7e-91b4-03c3768e4143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:08.484973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a542c29-1b65-4f7e-91b4-03c3768e4143 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:08.495362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1391/2772] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:10.081880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:10.083820 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:10.097946 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d5296-bf59-4d55-95a2-28adc44f85de None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:10.102512 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:10.103391 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:10.103719 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:10.103996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] PATH_INFO: `/v3/users/f9a11ce951c342158352115125fb215e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:10.105203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a11ce951c342158352115125fb215e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:10.107152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:10.294702 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a11ce951c342158352115125fb215e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:10.358744 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a11ce951c342158352115125fb215e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:10.359409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a11ce951c342158352115125fb215e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:10.360007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a11ce951c342158352115125fb215e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:10.367783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a11ce951c342158352115125fb215e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:10.387495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1382/2773] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:10 2022] DELETE /identity/v3/users/f9a11ce951c342158352115125fb215e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:10.392230 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:10.392723 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:10.393262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:10.411577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:10.413053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:10.500174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1392/2774] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:10.514118 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:10.515889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:10.577664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c94aa-d0be-49c5-b044-8130af44f818 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:10.582845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:10.584161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:10.584161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:10.584161 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:10.594998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:10.597599 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:10.612121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1383/2775] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:11.193514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:11.195686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:11.209077 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ac414-11a0-4da3-8f49-e38aa0fa0055 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:11.215256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:11.218174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:11.218174 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:11.218961 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] PATH_INFO: `/v3/projects/126bee929cff4816851a1e7b16cccdec` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:11.220277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126bee929cff4816851a1e7b16cccdec)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:11.224982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:11.343707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126bee929cff4816851a1e7b16cccdec', 'request_id': 'req-a7f42a63-b76d-4dce-be4f-91628db52900'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.357542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126bee929cff4816851a1e7b16cccdec', 'request_id': 'req-a7f42a63-b76d-4dce-be4f-91628db52900'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.442680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126bee929cff4816851a1e7b16cccdec', 'request_id': 'req-a7f42a63-b76d-4dce-be4f-91628db52900'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.458962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] The token cache is being invalidate because project 126bee929cff4816851a1e7b16cccdec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:11.459299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.460468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.464301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1393/2776] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:11 2022] DELETE /identity/v3/projects/126bee929cff4816851a1e7b16cccdec => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:11.468030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:11.478043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39aa96-a540-4eae-9458-27f17c7dc1ef service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:11.547947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:11.548819 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:11.549103 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:11.550486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] PATH_INFO: `/v3/users/b98484a8617648aa981e074d8e6ad1d0` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:11.551826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98484a8617648aa981e074d8e6ad1d0)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:11.553767 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:11.777250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98484a8617648aa981e074d8e6ad1d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.848320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98484a8617648aa981e074d8e6ad1d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.848943 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98484a8617648aa981e074d8e6ad1d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.849662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98484a8617648aa981e074d8e6ad1d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.857136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-ed2fb141-7475-4cf3-b206-75f529d51a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98484a8617648aa981e074d8e6ad1d0'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:11.875792 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1384/2777] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:11 2022] DELETE /identity/v3/users/b98484a8617648aa981e074d8e6ad1d0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:12.537506 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:12.539283 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:12.556880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f42a63-b76d-4dce-be4f-91628db52900 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:12.651759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:12.652820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:12.653154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:12.653461 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] PATH_INFO: `/v3/projects/e165c64716a04a47a9cb7d25942bd5e0` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:12.654755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e165c64716a04a47a9cb7d25942bd5e0)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:12.656824 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:12.817954 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e165c64716a04a47a9cb7d25942bd5e0', 'request_id': 'req-a3de8773-7365-4986-91a2-0d8c45c33468'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:12.824685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e165c64716a04a47a9cb7d25942bd5e0', 'request_id': 'req-a3de8773-7365-4986-91a2-0d8c45c33468'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:12.924918 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e165c64716a04a47a9cb7d25942bd5e0', 'request_id': 'req-a3de8773-7365-4986-91a2-0d8c45c33468'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:12.937510 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] The token cache is being invalidate because project e165c64716a04a47a9cb7d25942bd5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:12.938133 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:12.938823 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-a3de8773-7365-4986-91a2-0d8c45c33468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:12.941116 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1394/2778] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:12 2022] DELETE /identity/v3/projects/e165c64716a04a47a9cb7d25942bd5e0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:12.947012 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abc33e-5b78-46ca-a195-e25db9eec96b None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:12.947541 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abc33e-5b78-46ca-a195-e25db9eec96b None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:12.947712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abc33e-5b78-46ca-a195-e25db9eec96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:12.973863 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-61abc33e-5b78-46ca-a195-e25db9eec96b None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:12.975250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-61abc33e-5b78-46ca-a195-e25db9eec96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:13.058316 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1385/2779] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:13.068046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073254e-1af3-40ce-8cdf-1271f49eb76e None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.068496 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073254e-1af3-40ce-8cdf-1271f49eb76e None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.068832 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073254e-1af3-40ce-8cdf-1271f49eb76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.094746 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b073254e-1af3-40ce-8cdf-1271f49eb76e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:13.096221 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b073254e-1af3-40ce-8cdf-1271f49eb76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:13.105989 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1395/2780] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:13.110270 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abc33e-5b78-46ca-a195-e25db9eec96b None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:13.123258 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abc33e-5b78-46ca-a195-e25db9eec96b None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:13.129420 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:13.130225 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.131066 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.131561 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.132547 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:57:13.133068 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:13.135140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:13.154072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1386/2781] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:57:13.158301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073254e-1af3-40ce-8cdf-1271f49eb76e None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:13.169456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073254e-1af3-40ce-8cdf-1271f49eb76e None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:13.177527 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:13.178849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.179208 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.179558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.180921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:13.183373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:13.266915 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1396/2782] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:13 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:13.268778 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:13.280242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4163e5-10ab-42ef-8c1f-b6078a92686d admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:13.348846 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:13.349903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.350408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.350688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.351998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:13.355165 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:13.465884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1387/2783] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:13 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:13.467627 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:13.478084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4917-7e40-4176-afb3-145791b0c165 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:13.483768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:13.484426 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.484834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.485111 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.485843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:13.487519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:13.498501 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1397/2784] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:13.503442 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:13.513931 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b577cc4-d069-4504-ae07-34ff67bb40b5 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:13.520717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d015d2d-0d38-4b2a-bbb2-fc5c2ee62b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:13.521406 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015d2d-0d38-4b2a-bbb2-fc5c2ee62b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.521824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015d2d-0d38-4b2a-bbb2-fc5c2ee62b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.522106 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d015d2d-0d38-4b2a-bbb2-fc5c2ee62b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.522885 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d015d2d-0d38-4b2a-bbb2-fc5c2ee62b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:13.528720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d015d2d-0d38-4b2a-bbb2-fc5c2ee62b60 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:13.536363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1388/2785] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:13.540420 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:13.551305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c674bbe-9a30-47a9-ab9c-9d67f63cb57f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:13.557563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:13.557563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.557563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.557563 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] PATH_INFO: `/v3/projects/cb32569700b6439c8dc800cfb4d683d2/users/94e5d184aa4e4dde9b7658c77255aaf8/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.573873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb32569700b6439c8dc800cfb4d683d2, user_id=94e5d184aa4e4dde9b7658c77255aaf8, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:13.576843 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:13.705228 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1398/2786] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:13 2022] PUT /identity/v3/projects/cb32569700b6439c8dc800cfb4d683d2/users/94e5d184aa4e4dde9b7658c77255aaf8/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:13.717092 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5939a-6a94-4e5b-a817-fa300c70e698 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.718519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5939a-6a94-4e5b-a817-fa300c70e698 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.718932 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5939a-6a94-4e5b-a817-fa300c70e698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.762088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-5dd5939a-6a94-4e5b-a817-fa300c70e698 None None] MFA Rules not processed for user `94e5d184aa4e4dde9b7658c77255aaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:13.775170 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-5dd5939a-6a94-4e5b-a817-fa300c70e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:13.862967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1389/2787] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:13.868237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:13.956957 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6774d5-ad97-4a5b-9944-ad2b306bddc7 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:13.961651 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:13.962625 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:13.962950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:13.963223 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:13.963964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:13.965963 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.021121 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.021772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.021772 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.053634 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] MFA Rules not processed for user `02c59be1b62c4774a050047b4f5364d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:14.054944 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:14.081628 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1399/2788] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:13 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:14.084845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.141575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1390/2789] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:14.149086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.150584 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:14.159249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489a051-c33c-4fe9-92ce-be4285b58bc1 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.163993 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.164659 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.164937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.165202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.166110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.166460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e01aa6-9ce0-446c-baf3-eccf0081e60c None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.167890 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.171338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.171995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.172279 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.172556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.173281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.175309 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.278386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1400/2790] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:14 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:14.278602 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1391/2791] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:14 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:14.279851 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.279980 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.289849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ac733-a16c-4082-b01b-26373e45e9e5 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.353573 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.354231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.354507 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.354780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.355549 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.355723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4d649-74c1-490d-869a-73bbf81e0556 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.357192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.360465 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.361119 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.361402 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.361711 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.362454 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.364409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.366896 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1401/2792] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:14.371318 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.381440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b2428-6db5-406d-981d-73164e8d3078 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.386010 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.386886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.387162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.387431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] PATH_INFO: `/v3/projects/5922045028f24896a97ed1de410e72b0/users/d5f4bd3c27ce4d64ac446a3439830ef6/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.402139 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5922045028f24896a97ed1de410e72b0, user_id=d5f4bd3c27ce4d64ac446a3439830ef6, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.404733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.432762 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1392/2793] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:14 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:14.436727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.446813 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170689fc-a0b9-43b4-95ad-5d6a619f823a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.451564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.452184 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.452458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.452726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.453473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.455130 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.465370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1393/2794] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:57:14.469203 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.478591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fd31-bf8e-47d9-89a2-45cea69929b9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.478769 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1402/2795] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:14 2022] PUT /identity/v3/projects/5922045028f24896a97ed1de410e72b0/users/d5f4bd3c27ce4d64ac446a3439830ef6/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:14.482341 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.543349 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.544319 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.544667 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.545014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] PATH_INFO: `/v3/projects/c6431eaca81f44a4aee9a57824826628/users/46443eb1ed26466b93b9668f43fd7410/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.563209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d8fed-7f6a-483a-9315-f98b69384d29 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.567280 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6431eaca81f44a4aee9a57824826628, user_id=46443eb1ed26466b93b9668f43fd7410, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.569209 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.570192 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.570546 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.570996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.571186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.571876 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.573944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.588390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1403/2796] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:14.592682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.603544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95414ae8-f705-4381-ac22-b315ee543305 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.608323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d1dec-01de-448c-b4b9-52fece9c0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.609272 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1dec-01de-448c-b4b9-52fece9c0ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.609623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1dec-01de-448c-b4b9-52fece9c0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.609962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d1dec-01de-448c-b4b9-52fece9c0ffe admin admin] PATH_INFO: `/v3/projects/5922045028f24896a97ed1de410e72b0/users/d5f4bd3c27ce4d64ac446a3439830ef6/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.612861 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d1dec-01de-448c-b4b9-52fece9c0ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5922045028f24896a97ed1de410e72b0, user_id=d5f4bd3c27ce4d64ac446a3439830ef6, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.615398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d1dec-01de-448c-b4b9-52fece9c0ffe admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.625932 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1404/2797] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:14 2022] PUT /identity/v3/projects/5922045028f24896a97ed1de410e72b0/users/d5f4bd3c27ce4d64ac446a3439830ef6/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:14.637067 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.638668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.638668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.639601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1394/2798] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:14 2022] PUT /identity/v3/projects/c6431eaca81f44a4aee9a57824826628/users/46443eb1ed26466b93b9668f43fd7410/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:14.643824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.668634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] MFA Rules not processed for user `d5f4bd3c27ce4d64ac446a3439830ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:14.669838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:14.714429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b230b-c897-47fd-a6c6-a34ee36349cc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.720639 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.721472 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.721626 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.721840 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.722577 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.724197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.736325 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1395/2799] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:14.741398 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.743436 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1405/2800] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:14.754281 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed472e-65a6-4e3e-9e48-97fa21e76935 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.757790 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:14.759667 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:14.764489 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.769483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.769483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.769483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] PATH_INFO: `/v3/projects/c6431eaca81f44a4aee9a57824826628/users/46443eb1ed26466b93b9668f43fd7410/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.770053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6431eaca81f44a4aee9a57824826628, user_id=46443eb1ed26466b93b9668f43fd7410, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.772726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.789646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1396/2801] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:14 2022] PUT /identity/v3/projects/c6431eaca81f44a4aee9a57824826628/users/46443eb1ed26466b93b9668f43fd7410/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:14.826293 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7192b48-707d-4995-9dd2-4edce8c4a3a9 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:14.879328 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0559de-fc7e-4b8c-901d-963ca89bcc3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:14.884030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0559de-fc7e-4b8c-901d-963ca89bcc3e service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:14.884030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0559de-fc7e-4b8c-901d-963ca89bcc3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:14.884030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0559de-fc7e-4b8c-901d-963ca89bcc3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:14.948745 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0559de-fc7e-4b8c-901d-963ca89bcc3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:14.950399 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0559de-fc7e-4b8c-901d-963ca89bcc3e service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:14.961120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1406/2802] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:15.953303 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:16.012300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9677d3-641b-4ac0-9aa1-b008c9df1ee1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:16.017111 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:16.022591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:16.022591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:16.022591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] PATH_INFO: `/v3/users/94e5d184aa4e4dde9b7658c77255aaf8` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:16.022591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e5d184aa4e4dde9b7658c77255aaf8)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:16.023115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:16.250156 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e5d184aa4e4dde9b7658c77255aaf8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:16.317053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e5d184aa4e4dde9b7658c77255aaf8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:16.318050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e5d184aa4e4dde9b7658c77255aaf8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:16.319884 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e5d184aa4e4dde9b7658c77255aaf8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:16.352747 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e5d184aa4e4dde9b7658c77255aaf8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:16.378503 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1397/2803] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:15 2022] DELETE /identity/v3/users/94e5d184aa4e4dde9b7658c77255aaf8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:16.382759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:16.383360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:16.383360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:16.406301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:16.408172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:16.506550 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1407/2804] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:16.516830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:16.518461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:16.633613 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5a0c-86a9-4866-96b3-28e3845f612c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:16.638347 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:16.639290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:16.639839 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:16.640321 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:16.652478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:16.661612 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:16.670988 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1398/2805] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:17.179724 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:17.181763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:17.203190 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcc107-31ba-4776-a164-810b04710729 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:17.215882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:17.216732 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:17.217012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:17.217280 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] PATH_INFO: `/v3/projects/cb32569700b6439c8dc800cfb4d683d2` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:17.218520 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb32569700b6439c8dc800cfb4d683d2)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:17.221576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:17.345117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb32569700b6439c8dc800cfb4d683d2', 'request_id': 'req-604c0923-e79b-4abf-9f86-10bb0ca75998'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.352165 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb32569700b6439c8dc800cfb4d683d2', 'request_id': 'req-604c0923-e79b-4abf-9f86-10bb0ca75998'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.425626 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb32569700b6439c8dc800cfb4d683d2', 'request_id': 'req-604c0923-e79b-4abf-9f86-10bb0ca75998'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.445671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] The token cache is being invalidate because project cb32569700b6439c8dc800cfb4d683d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:17.446046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.446917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.448836 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1408/2806] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:17 2022] DELETE /identity/v3/projects/cb32569700b6439c8dc800cfb4d683d2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:17.458890 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:17.474680 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7240f3-b348-44e7-835c-fcbf8b524a67 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:17.559004 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:17.560313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:17.560822 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:17.561299 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] PATH_INFO: `/v3/users/d5f4bd3c27ce4d64ac446a3439830ef6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:17.566647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f4bd3c27ce4d64ac446a3439830ef6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:17.569471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:17.767585 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f4bd3c27ce4d64ac446a3439830ef6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.893642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f4bd3c27ce4d64ac446a3439830ef6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.894275 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f4bd3c27ce4d64ac446a3439830ef6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.895091 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f4bd3c27ce4d64ac446a3439830ef6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.904712 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-5838a1a8-5ae1-472a-989e-4f511d03ff47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f4bd3c27ce4d64ac446a3439830ef6'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:17.922743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1399/2807] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:17 2022] DELETE /identity/v3/users/d5f4bd3c27ce4d64ac446a3439830ef6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:18.411828 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:18.413712 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:18.427531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0923-e79b-4abf-9f86-10bb0ca75998 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:18.507480 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:18.508551 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:18.509021 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:18.509400 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] PATH_INFO: `/v3/projects/5922045028f24896a97ed1de410e72b0` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:18.510663 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5922045028f24896a97ed1de410e72b0)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:18.513838 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:18.660892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5922045028f24896a97ed1de410e72b0', 'request_id': 'req-fe68d1e5-5326-4cca-8cbb-992afc1e7635'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:18.668177 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5922045028f24896a97ed1de410e72b0', 'request_id': 'req-fe68d1e5-5326-4cca-8cbb-992afc1e7635'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:18.733813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5922045028f24896a97ed1de410e72b0', 'request_id': 'req-fe68d1e5-5326-4cca-8cbb-992afc1e7635'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:18.751577 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] The token cache is being invalidate because project 5922045028f24896a97ed1de410e72b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:18.751934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:18.752713 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fe68d1e5-5326-4cca-8cbb-992afc1e7635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:18.760202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1409/2808] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:18 2022] DELETE /identity/v3/projects/5922045028f24896a97ed1de410e72b0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:18.765575 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48f82-348a-4319-bc26-4573dda54ef1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:18.766072 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48f82-348a-4319-bc26-4573dda54ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:18.766186 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48f82-348a-4319-bc26-4573dda54ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:18.786421 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f9c48f82-348a-4319-bc26-4573dda54ef1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:18.787880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f9c48f82-348a-4319-bc26-4573dda54ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:18.862133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1400/2809] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:18.879459 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5744-6184-4766-a296-1d806cea6765 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:18.879813 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5744-6184-4766-a296-1d806cea6765 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:18.880204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5744-6184-4766-a296-1d806cea6765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:18.902404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c6bd5744-6184-4766-a296-1d806cea6765 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:18.903903 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c6bd5744-6184-4766-a296-1d806cea6765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:18.915211 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1410/2810] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:18.919849 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48f82-348a-4319-bc26-4573dda54ef1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:18.932140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48f82-348a-4319-bc26-4573dda54ef1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:18.937672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:18.938425 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:18.939262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:18.939685 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:18.941181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:57:18.942285 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:18.944100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:18.963323 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd5744-6184-4766-a296-1d806cea6765 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:18.968985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1401/2811] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:57:18.975875 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd5744-6184-4766-a296-1d806cea6765 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:18.982879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:18.982879 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:18.983444 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:18.983992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:18.984928 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:18.987359 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:19.074934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1411/2812] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:18 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:19.084647 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:19.100582 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654fe2a-fd42-48da-b2ea-c2cf39f2fbd1 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:19.168218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:19.169030 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:19.170243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:19.170243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:19.170603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:19.172649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:19.293122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1402/2813] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:19 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:19.297291 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:19.308927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0a8a1-2e7a-4d55-a674-33d8bee83f51 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:19.315024 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:19.316122 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:19.316255 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:19.316440 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:19.317497 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:19.319000 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:19.331295 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1412/2814] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:57:19.335695 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:19.346864 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a50d9-b02e-4de8-9631-c449674b082a admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:19.359329 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973763d9-43d2-48c0-ace7-c751225ea3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:19.360428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973763d9-43d2-48c0-ace7-c751225ea3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:19.360428 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973763d9-43d2-48c0-ace7-c751225ea3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:19.360857 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973763d9-43d2-48c0-ace7-c751225ea3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:19.361756 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973763d9-43d2-48c0-ace7-c751225ea3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:19.363529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973763d9-43d2-48c0-ace7-c751225ea3b9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:19.374473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1403/2815] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:19.378950 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:19.393159 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccdf32-680c-4fe7-b918-8a4056bb559a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:19.398719 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:19.399609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:19.399885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:19.400163 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] PATH_INFO: `/v3/projects/efb8839cf11645cead042cb35ea89765/users/d3f96a2626794075b0c3d9cc33738130/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:19.416938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb8839cf11645cead042cb35ea89765, user_id=d3f96a2626794075b0c3d9cc33738130, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:19.419986 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:19.470195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1413/2816] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:19 2022] PUT /identity/v3/projects/efb8839cf11645cead042cb35ea89765/users/d3f96a2626794075b0c3d9cc33738130/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:19.481422 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5882c-9220-4e8d-8e4e-060c78a1b481 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:19.481713 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5882c-9220-4e8d-8e4e-060c78a1b481 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:19.481985 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5882c-9220-4e8d-8e4e-060c78a1b481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:19.516073 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-22d5882c-9220-4e8d-8e4e-060c78a1b481 None None] MFA Rules not processed for user `d3f96a2626794075b0c3d9cc33738130`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:19.517963 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-22d5882c-9220-4e8d-8e4e-060c78a1b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:19.615498 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:19.616426 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1404/2817] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:19.694060 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1073b5f-6f78-46b3-a44e-5e1571dfbf56 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:19.699054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:19.699782 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:19.700132 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:19.700472 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] PATH_INFO: `/v3/projects` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:19.701231 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:19.703326 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:19.831430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1414/2818] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:19 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:57:19.835499 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5882c-9220-4e8d-8e4e-060c78a1b481 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:19.847176 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5882c-9220-4e8d-8e4e-060c78a1b481 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:19.909580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:19.910269 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:19.915290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:19.915290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] PATH_INFO: `/v3/users` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:19.915290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:19.915290 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:20.009653 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1405/2819] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:19 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:57:20.010885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:20.021271 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b915e9-2880-4426-8951-d09b8fcdd22d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:20.026256 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:20.026953 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.027241 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.027515 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.028277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:20.029867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:20.044929 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1415/2820] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:20.046127 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:20.058509 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61242-f341-4792-988b-64c8270c545f admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:20.064257 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:20.067022 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.067488 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.067929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] PATH_INFO: `/v3/projects/9f335d14e17a4aaa981fd1aea4b60df6/users/8b54831916644bf0bed17a5b8fb1e0ab/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.092027 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f335d14e17a4aaa981fd1aea4b60df6, user_id=8b54831916644bf0bed17a5b8fb1e0ab, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:20.095077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:20.171418 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1406/2821] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:20 2022] PUT /identity/v3/projects/9f335d14e17a4aaa981fd1aea4b60df6/users/8b54831916644bf0bed17a5b8fb1e0ab/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:20.172608 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:20.185100 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cd6c2-510a-4186-9f0f-d4fa22024982 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:20.247763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8bd3-72bb-4dd8-b6c3-922ee366418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:20.248442 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8bd3-72bb-4dd8-b6c3-922ee366418f admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.248722 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8bd3-72bb-4dd8-b6c3-922ee366418f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.248996 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8bd3-72bb-4dd8-b6c3-922ee366418f admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.249735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8bd3-72bb-4dd8-b6c3-922ee366418f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:20.251354 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8bd3-72bb-4dd8-b6c3-922ee366418f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:20.262893 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1416/2822] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:20.266649 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:20.277276 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f64b6-ebc9-4224-a8ad-3ef6d2171d27 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:20.287523 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:20.291579 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.292206 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.293243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] PATH_INFO: `/v3/projects/9f335d14e17a4aaa981fd1aea4b60df6/users/8b54831916644bf0bed17a5b8fb1e0ab/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.295836 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f335d14e17a4aaa981fd1aea4b60df6, user_id=8b54831916644bf0bed17a5b8fb1e0ab, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:20.301610 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:20.319197 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1407/2823] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:20 2022] PUT /identity/v3/projects/9f335d14e17a4aaa981fd1aea4b60df6/users/8b54831916644bf0bed17a5b8fb1e0ab/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:20.330356 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f754-702f-49fb-839e-58648c80dd9c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.331094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f754-702f-49fb-839e-58648c80dd9c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.331094 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f754-702f-49fb-839e-58648c80dd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.360949 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-dc00f754-702f-49fb-839e-58648c80dd9c None None] MFA Rules not processed for user `8b54831916644bf0bed17a5b8fb1e0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:20.362940 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-dc00f754-702f-49fb-839e-58648c80dd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:20.451977 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1417/2824] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:20.459352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:20.461937 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:20.509598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302270e-69fc-4b3c-a97f-1c8abccc8d73 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.510093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302270e-69fc-4b3c-a97f-1c8abccc8d73 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.510215 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302270e-69fc-4b3c-a97f-1c8abccc8d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.545860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-b302270e-69fc-4b3c-a97f-1c8abccc8d73 None None] MFA Rules not processed for user `46443eb1ed26466b93b9668f43fd7410`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:20.548203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-b302270e-69fc-4b3c-a97f-1c8abccc8d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:20.568843 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1619d-858a-4e4f-a182-1d21e2e5cb18 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:20.572558 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:20.573198 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.573473 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.573771 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.583735 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:20.585192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:20.595063 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1408/2825] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:20.636747 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1418/2826] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:20.650951 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:20.652353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:20.731067 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8e839-2ce1-47f5-aee6-1d7d956a4d86 service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:20.749358 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72317f5c187c41e9b2d1c53c9cedcd1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:20.750641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:20.750896 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:20.751642 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:20.754075 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:20.819291 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:20.820777 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:20.830274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1409/2827] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:21.125403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017bcdc-8a5c-4f35-b0bf-50a4e2c4771c None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:21.125688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017bcdc-8a5c-4f35-b0bf-50a4e2c4771c None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:21.125958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017bcdc-8a5c-4f35-b0bf-50a4e2c4771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:21.146562 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-d017bcdc-8a5c-4f35-b0bf-50a4e2c4771c None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:21.147936 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d017bcdc-8a5c-4f35-b0bf-50a4e2c4771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:21.250124 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1419/2828] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:21.403516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:21.405019 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:21.480335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf3a2-23aa-419c-9cfd-e69f9014adbe service glance] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:21.485741 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a8c29-a747-4bde-babe-5319a0608862 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:21.486526 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8c29-a747-4bde-babe-5319a0608862 service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:21.486832 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8c29-a747-4bde-babe-5319a0608862 service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:21.487115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a8c29-a747-4bde-babe-5319a0608862 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:21.496947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a8c29-a747-4bde-babe-5319a0608862 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:21.498564 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a8c29-a747-4bde-babe-5319a0608862 service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:21.507862 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1410/2829] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:57:23.705976 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017bcdc-8a5c-4f35-b0bf-50a4e2c4771c None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:23.780726 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017bcdc-8a5c-4f35-b0bf-50a4e2c4771c None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:23.787917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:23.789109 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:23.789585 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:23.790050 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] PATH_INFO: `/v3/users/d3f96a2626794075b0c3d9cc33738130` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:23.791516 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f96a2626794075b0c3d9cc33738130)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:23.793776 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:23.983107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f96a2626794075b0c3d9cc33738130'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:23.983107 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f96a2626794075b0c3d9cc33738130'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:23.996180 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f96a2626794075b0c3d9cc33738130'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:24.004262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f96a2626794075b0c3d9cc33738130'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:24.065618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f96a2626794075b0c3d9cc33738130'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:24.072064 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1420/2830] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:23 2022] DELETE /identity/v3/users/d3f96a2626794075b0c3d9cc33738130 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:24.076780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:24.077326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:24.077326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:24.100824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:24.102034 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:24.168148 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1411/2831] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:24.179201 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:24.180752 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:24.244522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3db70-8122-4229-b80b-3de9cdeaa18f admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:24.248353 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:24.249004 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:24.249284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:24.249558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:24.259892 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:24.261347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:24.272456 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1421/2832] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:25.012101 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:25.015745 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:25.040656 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba3054-a946-443b-a77b-2c8500b4c36e None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:25.064344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:25.065480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:25.065480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:25.065783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] PATH_INFO: `/v3/projects/efb8839cf11645cead042cb35ea89765` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:25.067218 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb8839cf11645cead042cb35ea89765)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:25.069445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:25.219095 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb8839cf11645cead042cb35ea89765', 'request_id': 'req-912a1d8e-5920-44c4-99ac-5b3bc8518095'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.348298 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb8839cf11645cead042cb35ea89765', 'request_id': 'req-912a1d8e-5920-44c4-99ac-5b3bc8518095'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.357508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb8839cf11645cead042cb35ea89765', 'request_id': 'req-912a1d8e-5920-44c4-99ac-5b3bc8518095'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.393320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] The token cache is being invalidate because project efb8839cf11645cead042cb35ea89765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:25.393320 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.395720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.399385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1412/2833] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:25 2022] DELETE /identity/v3/projects/efb8839cf11645cead042cb35ea89765 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:25.403634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:25.425017 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ae020-7f44-4fc1-bd64-720b844be427 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:25.551199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:25.552405 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:25.553011 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:25.553102 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] PATH_INFO: `/v3/users/8b54831916644bf0bed17a5b8fb1e0ab` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:25.554416 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b54831916644bf0bed17a5b8fb1e0ab)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:25.557367 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:25.831555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b54831916644bf0bed17a5b8fb1e0ab'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.832454 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b54831916644bf0bed17a5b8fb1e0ab'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.850357 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b54831916644bf0bed17a5b8fb1e0ab'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.857973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b54831916644bf0bed17a5b8fb1e0ab'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.958671 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-187056aa-f9d5-4a30-8550-5b89f40af850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b54831916644bf0bed17a5b8fb1e0ab'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:25.965737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1422/2834] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:25 2022] DELETE /identity/v3/users/8b54831916644bf0bed17a5b8fb1e0ab => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:26.469033 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:26.472483 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:26.488011 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a1d8e-5920-44c4-99ac-5b3bc8518095 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:26.600662 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:26.601589 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:26.601967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:26.602352 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] PATH_INFO: `/v3/projects/9f335d14e17a4aaa981fd1aea4b60df6` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:26.603994 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f335d14e17a4aaa981fd1aea4b60df6)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:26.606112 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:26.745505 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f335d14e17a4aaa981fd1aea4b60df6', 'request_id': 'req-0e36d4d3-ee62-46ca-a815-d0175afc02c2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:26.804850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f335d14e17a4aaa981fd1aea4b60df6', 'request_id': 'req-0e36d4d3-ee62-46ca-a815-d0175afc02c2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:26.813344 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f335d14e17a4aaa981fd1aea4b60df6', 'request_id': 'req-0e36d4d3-ee62-46ca-a815-d0175afc02c2'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:26.830823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] The token cache is being invalidate because project 9f335d14e17a4aaa981fd1aea4b60df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:26.831723 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:26.832565 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-0e36d4d3-ee62-46ca-a815-d0175afc02c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:26.834162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1413/2835] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:26 2022] DELETE /identity/v3/projects/9f335d14e17a4aaa981fd1aea4b60df6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:26.842771 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417cdf0-a687-42d9-ae39-935821f23859 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:26.843284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417cdf0-a687-42d9-ae39-935821f23859 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:26.843581 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417cdf0-a687-42d9-ae39-935821f23859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:26.864598 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-c417cdf0-a687-42d9-ae39-935821f23859 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:26.865717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c417cdf0-a687-42d9-ae39-935821f23859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:26.936410 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1423/2836] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:26.944935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cda81-86ca-42b3-bcac-77dafee58581 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:26.945219 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cda81-86ca-42b3-bcac-77dafee58581 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:26.945500 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cda81-86ca-42b3-bcac-77dafee58581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:26.966824 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-ac3cda81-86ca-42b3-bcac-77dafee58581 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:26.968104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-ac3cda81-86ca-42b3-bcac-77dafee58581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:26.978826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1414/2837] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:26.981437 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417cdf0-a687-42d9-ae39-935821f23859 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:26.992664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417cdf0-a687-42d9-ae39-935821f23859 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:26.997725 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:26.998921 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:26.999267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:26.999614 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.000427 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:57:27.000793 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:27.003245 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:27.016622 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1424/2838] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:57:27.021286 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cda81-86ca-42b3-bcac-77dafee58581 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:27.030829 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cda81-86ca-42b3-bcac-77dafee58581 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:27.036939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:27.037605 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:27.037877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:27.038152 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.038919 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:27.040847 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:27.138108 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1415/2839] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:27 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:27.139332 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:27.151134 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6c369-9cf3-4c4e-a635-99e14c687f12 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:27.213150 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:27.213933 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:27.214216 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:27.214485 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.215226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:27.217136 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:27.296172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1425/2840] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:27 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:27.300996 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:27.312571 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560c5af-963d-43cd-9ce9-340b39e71fca admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:27.318283 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:27.319324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:27.319668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:27.320003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.320894 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:27.325173 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:27.340603 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1416/2841] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:27.343204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:27.359205 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156382-1eeb-4f1d-9480-69402cca5709 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:27.370703 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa7b41-cbb3-4ac8-a9c2-cd06c7cb1559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:27.371430 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7b41-cbb3-4ac8-a9c2-cd06c7cb1559 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:27.375735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7b41-cbb3-4ac8-a9c2-cd06c7cb1559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:27.376085 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa7b41-cbb3-4ac8-a9c2-cd06c7cb1559 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.377013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7b41-cbb3-4ac8-a9c2-cd06c7cb1559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:27.378666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa7b41-cbb3-4ac8-a9c2-cd06c7cb1559 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:27.397274 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1426/2842] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:27.401243 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:27.414224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc8d8-6940-4641-8d19-11aa9a3daa96 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:27.420015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:27.420905 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:27.421185 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:27.421458 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] PATH_INFO: `/v3/projects/d993ff627d4248dc8910ea7604a28e40/users/a7fbb7d2dd514a5382e89862a7dd45f5/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.443193 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d993ff627d4248dc8910ea7604a28e40, user_id=a7fbb7d2dd514a5382e89862a7dd45f5, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:27.445853 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:27.541003 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1417/2843] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:27 2022] PUT /identity/v3/projects/d993ff627d4248dc8910ea7604a28e40/users/a7fbb7d2dd514a5382e89862a7dd45f5/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:27.542262 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ea81c-cdce-40ac-9b4a-08b572cc7111 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:27.542623 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ea81c-cdce-40ac-9b4a-08b572cc7111 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:27.543073 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ea81c-cdce-40ac-9b4a-08b572cc7111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.580666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3e7ea81c-cdce-40ac-9b4a-08b572cc7111 None None] MFA Rules not processed for user `a7fbb7d2dd514a5382e89862a7dd45f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:27.582366 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3e7ea81c-cdce-40ac-9b4a-08b572cc7111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:27.670629 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1427/2844] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:27.680699 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:27.682507 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:27.758043 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547c7a-5673-4d83-87c8-e0600878c773 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:27.763192 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:27.763998 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:27.764401 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:27.764782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:27.778295 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:27.780430 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:27.793322 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1418/2845] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:32.557071 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266bed7-941a-4958-856c-42774a4600bc None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:32.560421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266bed7-941a-4958-856c-42774a4600bc None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:32.560421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266bed7-941a-4958-856c-42774a4600bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:32.575670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-8266bed7-941a-4958-856c-42774a4600bc None None] MFA Rules not processed for user `02c59be1b62c4774a050047b4f5364d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:32.576866 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8266bed7-941a-4958-856c-42774a4600bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:32.632239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1428/2846] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:32.879457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:32.880850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:32.936013 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba08d7b-2a54-441a-9210-e63fd72d68fb service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:32.940053 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:32.940728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:32.941017 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:32.941293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:32.943136 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:32.953036 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:32.954460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:32.962844 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1419/2847] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:35.922757 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe307d8-8ec7-4b4c-a2ec-de2ccb805b3d None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:35.923970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe307d8-8ec7-4b4c-a2ec-de2ccb805b3d None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:35.924084 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe307d8-8ec7-4b4c-a2ec-de2ccb805b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:35.946822 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-9fe307d8-8ec7-4b4c-a2ec-de2ccb805b3d None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:35.948362 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-9fe307d8-8ec7-4b4c-a2ec-de2ccb805b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:36.015580 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1429/2848] 10.222.0.21 () {58 vars in 1009 bytes} [Mon Jan 31 04:57:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:36.028000 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:36.029437 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:36.102616 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451d4ea-35e0-44fe-ac97-fc4528830fd4 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:36.107743 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88be3c7-6c4b-4ce6-be1d-de055b3c744e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:36.108386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be3c7-6c4b-4ce6-be1d-de055b3c744e service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:36.108664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be3c7-6c4b-4ce6-be1d-de055b3c744e service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:36.108935 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be3c7-6c4b-4ce6-be1d-de055b3c744e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:36.118088 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88be3c7-6c4b-4ce6-be1d-de055b3c744e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:36.119976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88be3c7-6c4b-4ce6-be1d-de055b3c744e service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:36.129346 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1420/2849] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 04:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 04:57:36.994849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe307d8-8ec7-4b4c-a2ec-de2ccb805b3d None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:37.058885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe307d8-8ec7-4b4c-a2ec-de2ccb805b3d None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:37.064539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:37.065604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:37.065884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:37.066156 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] PATH_INFO: `/v3/users/a7fbb7d2dd514a5382e89862a7dd45f5` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:37.067422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fbb7d2dd514a5382e89862a7dd45f5)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:37.069355 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:37.255788 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fbb7d2dd514a5382e89862a7dd45f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:37.256545 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fbb7d2dd514a5382e89862a7dd45f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:37.269737 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fbb7d2dd514a5382e89862a7dd45f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:37.276589 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fbb7d2dd514a5382e89862a7dd45f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:37.350347 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fbb7d2dd514a5382e89862a7dd45f5'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:37.356755 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1430/2850] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:57:36 2022] DELETE /identity/v3/users/a7fbb7d2dd514a5382e89862a7dd45f5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:37.361591 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:37.362140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:37.362140 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:37.380624 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:37.381873 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:37.443817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1421/2851] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:37.453514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:37.456083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:37.517733 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522772-e495-448f-879c-700f0cd28c4a admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:37.521452 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d5b86-6727-4d32-bfa5-d8888a5f2868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:37.522090 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5b86-6727-4d32-bfa5-d8888a5f2868 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:37.522373 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5b86-6727-4d32-bfa5-d8888a5f2868 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:37.522649 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d5b86-6727-4d32-bfa5-d8888a5f2868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:37.531499 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5b86-6727-4d32-bfa5-d8888a5f2868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:37.533301 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d5b86-6727-4d32-bfa5-d8888a5f2868 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:37.544495 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1431/2852] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:37.944160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:37.945684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:37.965459 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360150ce-ef27-4d99-9d56-0e304104290d None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:37.970826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:37.972005 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:37.972334 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:37.972635 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] PATH_INFO: `/v3/projects/d993ff627d4248dc8910ea7604a28e40` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:37.974070 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d993ff627d4248dc8910ea7604a28e40)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:37.976297 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:38.090370 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd993ff627d4248dc8910ea7604a28e40', 'request_id': 'req-8d340093-7a10-463b-be02-db3ca0453ac4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:38.167519 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd993ff627d4248dc8910ea7604a28e40', 'request_id': 'req-8d340093-7a10-463b-be02-db3ca0453ac4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:38.175464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd993ff627d4248dc8910ea7604a28e40', 'request_id': 'req-8d340093-7a10-463b-be02-db3ca0453ac4'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:38.187516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] The token cache is being invalidate because project d993ff627d4248dc8910ea7604a28e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:57:38.187742 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:38.188386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8d340093-7a10-463b-be02-db3ca0453ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:57:38.190664 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1422/2853] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:57:37 2022] DELETE /identity/v3/projects/d993ff627d4248dc8910ea7604a28e40 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:38.196555 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2553-da79-4f31-bba2-ea982b9a4a36 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.197058 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2553-da79-4f31-bba2-ea982b9a4a36 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.197169 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a2553-da79-4f31-bba2-ea982b9a4a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.215682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-3b2a2553-da79-4f31-bba2-ea982b9a4a36 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:38.217053 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3b2a2553-da79-4f31-bba2-ea982b9a4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:38.277195 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1432/2854] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:38.286090 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006cb1-088f-4ea4-af2b-f9d7bca77bd1 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.286463 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006cb1-088f-4ea4-af2b-f9d7bca77bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.286769 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a006cb1-088f-4ea4-af2b-f9d7bca77bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.305481 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-1a006cb1-088f-4ea4-af2b-f9d7bca77bd1 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:38.306675 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1a006cb1-088f-4ea4-af2b-f9d7bca77bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:38.315220 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1423/2855] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:38.319521 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a2553-da79-4f31-bba2-ea982b9a4a36 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:38.329315 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a2553-da79-4f31-bba2-ea982b9a4a36 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:38.334927 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:38.335668 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.336082 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.336364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.337106 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 31 04:57:38.337409 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:38.339037 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:38.351864 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1433/2856] 10.222.0.21 () {58 vars in 1152 bytes} [Mon Jan 31 04:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 31 04:57:38.356408 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a006cb1-088f-4ea4-af2b-f9d7bca77bd1 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:38.365974 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a006cb1-088f-4ea4-af2b-f9d7bca77bd1 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:38.371317 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:38.371967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.372252 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.372529 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.373244 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:38.375187 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:38.472293 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1424/2857] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:38 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 31 04:57:38.476728 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:38.487767 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ce81-456d-4e49-a1dc-e89d8bcd1d5e admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:38.546581 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:38.547284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.547570 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.547848 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.549286 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:38.551397 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:38.637664 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1434/2858] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:38 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:57:38.641517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:38.652958 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e109-a7a8-4ae1-904d-91f146a67a4c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:38.658339 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:38.659302 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.659608 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.659879 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.660621 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:38.662216 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:38.673977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1425/2859] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:57:38.678032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:38.688098 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebc5e8-d5a7-4e4e-ae09-d6d510df3b68 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:38.693616 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e44dc-0866-4b49-b7ca-fa8fc0503a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:38.694276 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e44dc-0866-4b49-b7ca-fa8fc0503a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.694552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e44dc-0866-4b49-b7ca-fa8fc0503a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.694845 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e44dc-0866-4b49-b7ca-fa8fc0503a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.695579 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e44dc-0866-4b49-b7ca-fa8fc0503a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:38.697197 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e44dc-0866-4b49-b7ca-fa8fc0503a61 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:38.707973 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1435/2860] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:57:38.712177 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:38.723536 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1482bf-0363-431e-9193-0c6d7654c40e admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:38.727990 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:38.728848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] REQUEST_METHOD: `PUT` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.729125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.729385 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] PATH_INFO: `/v3/projects/4cf3ab219d9f44e1ab973f1d63347066/users/bcaad1042b434b5a8ff8f3a0acc585ec/roles/9d58693d11544e18a74ccda41182d77e` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.745563 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf3ab219d9f44e1ab973f1d63347066, user_id=bcaad1042b434b5a8ff8f3a0acc585ec, role_id=9d58693d11544e18a74ccda41182d77e)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:38.748444 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:38.854441 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1426/2861] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:38 2022] PUT /identity/v3/projects/4cf3ab219d9f44e1ab973f1d63347066/users/bcaad1042b434b5a8ff8f3a0acc585ec/roles/9d58693d11544e18a74ccda41182d77e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:38.859917 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e1ab-d391-4c60-9075-bf4f64313d61 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:38.860300 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e1ab-d391-4c60-9075-bf4f64313d61 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:38.860686 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e1ab-d391-4c60-9075-bf4f64313d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:38.879097 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-66f9e1ab-d391-4c60-9075-bf4f64313d61 None None] MFA Rules not processed for user `2797021a13d04785b82a692e77ce62df`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:38.880310 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-66f9e1ab-d391-4c60-9075-bf4f64313d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:38.940552 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1436/2862] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 31 04:57:38.949923 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:38.951726 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:39.019906 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536efa1e-49ed-4fbf-9767-e5759cd16298 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:39.023556 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:39.024200 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:39.024478 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:39.024753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:39.035060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:39.036517 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:39.047782 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1427/2863] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:45.950531 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a8c29-0533-4a29-82ec-e27eb014e3ef None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:45.951093 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a8c29-0533-4a29-82ec-e27eb014e3ef None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:45.951191 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a8c29-0533-4a29-82ec-e27eb014e3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:45.982431 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-976a8c29-0533-4a29-82ec-e27eb014e3ef None None] MFA Rules not processed for user `bcaad1042b434b5a8ff8f3a0acc585ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:45.983938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-976a8c29-0533-4a29-82ec-e27eb014e3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:46.058135 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1437/2864] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:46.061172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:46.071382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b1aff-9b9b-4499-862c-14a399a1e508 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:46.076007 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:46.076655 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:46.076939 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:46.077215 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:46.077922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:46.084580 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:46.149429 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1428/2865] 10.222.0.21 () {60 vars in 1152 bytes} [Mon Jan 31 04:57:46 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:57:46.153237 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a8c29-0533-4a29-82ec-e27eb014e3ef None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:46.164433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a8c29-0533-4a29-82ec-e27eb014e3ef None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:46.223214 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:46.223878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:46.224152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:46.224418 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] PATH_INFO: `/v3/users` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:46.225142 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:46.227074 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:46.305202 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1438/2866] 10.222.0.21 () {60 vars in 1143 bytes} [Mon Jan 31 04:57:46 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 31 04:57:46.309355 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:46.320363 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890b138-0877-42a3-89d6-57ea72e4ddd4 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:46.325109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:46.325795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:46.326076 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:46.326351 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:46.327129 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:46.328800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:46.340826 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1429/2867] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 31 04:57:46.345661 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:46.356544 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3b2b-59e8-402a-a93c-5bc333413f9d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:46.361451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:46.362360 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:46.362637 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:46.362947 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] PATH_INFO: `/v3/projects/b985a28524c94a7eb30396bfb0844e08/users/a4f3348e999b41c28b56a945f10b4fdb/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:46.378694 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b985a28524c94a7eb30396bfb0844e08, user_id=a4f3348e999b41c28b56a945f10b4fdb, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:46.381412 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:46.454818 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1439/2868] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:46 2022] PUT /identity/v3/projects/b985a28524c94a7eb30396bfb0844e08/users/a4f3348e999b41c28b56a945f10b4fdb/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 04:57:46.458749 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:46.468995 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d2672-35b5-47c9-bca7-faa0ae9243d9 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:46.528850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73557613-95c0-48f6-8069-ad99805323e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:46.529524 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557613-95c0-48f6-8069-ad99805323e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:46.529801 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557613-95c0-48f6-8069-ad99805323e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:46.530069 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557613-95c0-48f6-8069-ad99805323e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:46.530877 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73557613-95c0-48f6-8069-ad99805323e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:46.532468 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73557613-95c0-48f6-8069-ad99805323e8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:46.545567 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1430/2869] 10.222.0.21 () {58 vars in 1121 bytes} [Mon Jan 31 04:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 31 04:57:46.550514 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:46.560860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4776a37-fbd4-4a04-bff6-289662949a78 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:46.566884 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:46.567768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:46.570850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:46.570850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] PATH_INFO: `/v3/projects/b985a28524c94a7eb30396bfb0844e08/users/a4f3348e999b41c28b56a945f10b4fdb/roles/f5c4e6312eb74b58b1dff95923bbfde9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:46.570850 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b985a28524c94a7eb30396bfb0844e08, user_id=a4f3348e999b41c28b56a945f10b4fdb, role_id=f5c4e6312eb74b58b1dff95923bbfde9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:46.573105 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:46.585183 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1440/2870] 10.222.0.21 () {60 vars in 1482 bytes} [Mon Jan 31 04:57:46 2022] PUT /identity/v3/projects/b985a28524c94a7eb30396bfb0844e08/users/a4f3348e999b41c28b56a945f10b4fdb/roles/f5c4e6312eb74b58b1dff95923bbfde9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:57:53.366390 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886efc-8efe-4806-8e4c-8f5147f61b88 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:53.367104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886efc-8efe-4806-8e4c-8f5147f61b88 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:53.367104 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8886efc-8efe-4806-8e4c-8f5147f61b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:53.533074 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-d8886efc-8efe-4806-8e4c-8f5147f61b88 None None] MFA Rules not processed for user `a4f3348e999b41c28b56a945f10b4fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:57:53.535717 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d8886efc-8efe-4806-8e4c-8f5147f61b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:53.602086 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1431/2871] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:57:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:57:53.613937 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:53.615672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:53.693251 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec53df-a4b1-4657-9603-cfec477143ae admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:53.698604 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:53.699277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:53.699554 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:53.699820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:53.753849 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:53.755467 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:53.764070 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1441/2872] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:57:55.080278 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8886efc-8efe-4806-8e4c-8f5147f61b88 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:57:55.109222 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8886efc-8efe-4806-8e4c-8f5147f61b88 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:57:55.116221 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:57:55.116947 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:57:55.117236 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:57:55.117516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:57:55.120077 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:57:55.153050 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:57:55.154637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:57:55.168366 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1432/2873] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:57:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 31 04:58:10.059166 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:10.139364 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a092ab-31b4-473c-a90a-215f40633b05 service nova] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:10.142979 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:10.143603 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:10.143882 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:10.144155 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:10.145916 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:10.224566 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:10.226110 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:10.235655 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1442/2874] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:58:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:58:12.285301 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:12.286513 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:12.343091 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b4a35-a9e3-479d-9a11-1413b264e3ad service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:12.348696 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc1cf1-9f81-4068-aff6-931ff65a1cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:12.349903 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1cf1-9f81-4068-aff6-931ff65a1cec service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:12.350213 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1cf1-9f81-4068-aff6-931ff65a1cec service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:12.350486 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1cf1-9f81-4068-aff6-931ff65a1cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:12.352337 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-dbcc1cf1-9f81-4068-aff6-931ff65a1cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:12.364414 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc1cf1-9f81-4068-aff6-931ff65a1cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:12.366039 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc1cf1-9f81-4068-aff6-931ff65a1cec service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:12.378087 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1433/2875] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:58:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:58:15.502938 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:15.508468 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:15.548811 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1936ce-5614-455e-a69d-0d88c11c114c service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:15.555944 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:15.556083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:15.556380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:15.556638 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:15.558595 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:15.669252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:15.671032 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:15.683117 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1443/2876] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:58:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:58:20.541701 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:20.542817 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:20.543780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:20.563625 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] MFA Rules not processed for user `bcaad1042b434b5a8ff8f3a0acc585ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 04:58:20.564834 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:20.572597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1434/2877] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 04:58:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 04:58:22.537204 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:22.547115 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053ea82-732d-4b57-9186-57095cfc0237 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:22.550735 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:22.551385 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:22.551666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:22.552768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:22.554602 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:22.639558 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:22.641009 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:22.660682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1444/2878] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:58:30.562543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:30.564261 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:30.580810 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a62017-d623-4a7a-b8b6-6572c3ed07c2 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:30.585962 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:30.586835 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:30.589495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:30.589495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] PATH_INFO: `/v3/users/3a231040d254416cb6af258aed9f9278` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:30.589495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a231040d254416cb6af258aed9f9278)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:30.590460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:30.765440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a231040d254416cb6af258aed9f9278'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:30.848338 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a231040d254416cb6af258aed9f9278'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:30.848889 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a231040d254416cb6af258aed9f9278'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:30.849480 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a231040d254416cb6af258aed9f9278'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:30.856470 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a231040d254416cb6af258aed9f9278'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:30.873324 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1435/2879] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:58:30 2022] DELETE /identity/v3/users/3a231040d254416cb6af258aed9f9278 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:58:31.078820 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:31.090377 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554ea5-ddf3-473c-834f-22f6bb1f95bd service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:31.153299 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:31.154154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:31.154433 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:31.154707 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] PATH_INFO: `/v3/projects/36c2584cb883458eaf6b3b04d55a9429` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:31.155934 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c2584cb883458eaf6b3b04d55a9429)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:31.157873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:31.250586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c2584cb883458eaf6b3b04d55a9429', 'request_id': 'req-5f1dec16-305e-4390-8fe5-b9fa4080b41d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.257358 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c2584cb883458eaf6b3b04d55a9429', 'request_id': 'req-5f1dec16-305e-4390-8fe5-b9fa4080b41d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.306044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c2584cb883458eaf6b3b04d55a9429', 'request_id': 'req-5f1dec16-305e-4390-8fe5-b9fa4080b41d'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.317768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] The token cache is being invalidate because project 36c2584cb883458eaf6b3b04d55a9429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:58:31.317768 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.318370 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.319982 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1445/2880] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:58:31 2022] DELETE /identity/v3/projects/36c2584cb883458eaf6b3b04d55a9429 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:58:31.324028 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:31.325433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:31.339015 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db411d8-bd7e-434c-8963-99b829f22670 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:31.395850 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:31.396550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:31.396823 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:31.397093 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] PATH_INFO: `/v3/users/4f96c4d423ff42d2bd482b17cdc98d6a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:31.398271 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f96c4d423ff42d2bd482b17cdc98d6a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:31.400250 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:31.535369 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f96c4d423ff42d2bd482b17cdc98d6a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.602830 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f96c4d423ff42d2bd482b17cdc98d6a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.603457 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f96c4d423ff42d2bd482b17cdc98d6a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.604051 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f96c4d423ff42d2bd482b17cdc98d6a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.611242 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f96c4d423ff42d2bd482b17cdc98d6a'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:31.628799 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1436/2881] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 04:58:31 2022] DELETE /identity/v3/users/4f96c4d423ff42d2bd482b17cdc98d6a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:58:31.895867 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:31.896277 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:31.909403 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dec16-305e-4390-8fe5-b9fa4080b41d admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:31.966113 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:31.967041 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:31.970046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:31.970046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] PATH_INFO: `/v3/projects/609ad2e21df74626a9c4eec39b67d8df` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:31.970046 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609ad2e21df74626a9c4eec39b67d8df)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:31.970679 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:32.071576 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609ad2e21df74626a9c4eec39b67d8df', 'request_id': 'req-fa597142-0186-407d-94a9-2f792ede7bd9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:32.078814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609ad2e21df74626a9c4eec39b67d8df', 'request_id': 'req-fa597142-0186-407d-94a9-2f792ede7bd9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:32.134264 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609ad2e21df74626a9c4eec39b67d8df', 'request_id': 'req-fa597142-0186-407d-94a9-2f792ede7bd9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:32.146386 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] The token cache is being invalidate because project 609ad2e21df74626a9c4eec39b67d8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 04:58:32.146684 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:32.147339 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 04:58:32.148878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1446/2882] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 04:58:31 2022] DELETE /identity/v3/projects/609ad2e21df74626a9c4eec39b67d8df => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 04:58:39.634720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:58:39.636172 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:39.692627 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42456a-1622-4cb3-baab-5debc03bcddc admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:58:39.738133 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:58:39.739380 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:58:39.739657 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:58:39.739929 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:58:39.741684 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:58:39.802024 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:58:39.803464 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:58:39.812641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1437/2883] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:58:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 04:59:39.516517 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 04:59:39.517924 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:59:39.605720 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa597142-0186-407d-94a9-2f792ede7bd9 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 04:59:39.610717 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6344c5-fd6a-4a26-9b59-c8bd8db13105 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 04:59:39.611380 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6344c5-fd6a-4a26-9b59-c8bd8db13105 service placement] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 04:59:39.612540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6344c5-fd6a-4a26-9b59-c8bd8db13105 service placement] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 04:59:39.612540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6344c5-fd6a-4a26-9b59-c8bd8db13105 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 04:59:39.613678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-de6344c5-fd6a-4a26-9b59-c8bd8db13105 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 04:59:39.625814 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6344c5-fd6a-4a26-9b59-c8bd8db13105 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 04:59:39.627422 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6344c5-fd6a-4a26-9b59-c8bd8db13105 service placement] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 04:59:39.637178 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1447/2884] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 04:59:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:00:34.599754 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:00:34.601228 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:00:34.680026 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff45c-d9bd-4a97-b0ba-bf19b3f35359 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:00:34.683672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:00:34.684294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:00:34.684573 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:00:34.684845 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:00:34.686646 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:00:34.773590 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:00:34.774641 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:00:34.794475 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1438/2885] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:00:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:00:41.076964 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:00:41.077424 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:00:41.077522 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:00:41.135267 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] MFA Rules not processed for user `c1d552a7c37744e1b7b61a33d34ceedb`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 05:00:41.136492 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:00:41.197878 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1448/2886] 10.222.0.21 () {58 vars in 967 bytes} [Mon Jan 31 05:00:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 05:00:41.237851 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:00:41.239274 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:00:41.325120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96477-d1ab-47fb-a128-68902c10f87f service cinder] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:00:41.330109 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77321e9c7ec34370b1b8246dde35911b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:00:41.330734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:00:41.331058 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:00:41.331335 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:00:41.339793 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:00:41.341353 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:00:41.349158 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1439/2887] 10.222.0.21 () {60 vars in 1384 bytes} [Mon Jan 31 05:00:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 31 05:00:49.681199 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:00:49.682698 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:00:49.746152 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6df876-4697-433a-83e5-8008d84244b6 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:00:49.750834 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:00:49.751685 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:00:49.751971 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:00:49.752311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] PATH_INFO: `/v3/users/02c59be1b62c4774a050047b4f5364d9` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:00:49.753451 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c59be1b62c4774a050047b4f5364d9)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:00:49.755404 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:00:49.938889 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c59be1b62c4774a050047b4f5364d9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:49.939535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c59be1b62c4774a050047b4f5364d9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:49.951688 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c59be1b62c4774a050047b4f5364d9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:49.958343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c59be1b62c4774a050047b4f5364d9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.017860 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c59be1b62c4774a050047b4f5364d9'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.024457 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1449/2888] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 05:00:49 2022] DELETE /identity/v3/users/02c59be1b62c4774a050047b4f5364d9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 05:00:50.245753 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:00:50.256128 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933b680-2e68-4352-a792-95624f225fcd service swift] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:00:50.311412 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:00:50.312254 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:00:50.312535 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:00:50.312807 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] PATH_INFO: `/v3/projects/e1637f6e48094653bebf0bc7af9aab9a` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:00:50.313986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1637f6e48094653bebf0bc7af9aab9a)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:00:50.315901 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:00:50.440009 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1637f6e48094653bebf0bc7af9aab9a', 'request_id': 'req-39422ce4-e27c-48a0-a84d-41bd385d606c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.503100 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1637f6e48094653bebf0bc7af9aab9a', 'request_id': 'req-39422ce4-e27c-48a0-a84d-41bd385d606c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.509872 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1637f6e48094653bebf0bc7af9aab9a', 'request_id': 'req-39422ce4-e27c-48a0-a84d-41bd385d606c'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.519776 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] The token cache is being invalidate because project e1637f6e48094653bebf0bc7af9aab9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 05:00:50.520105 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.520668 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.522262 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1440/2889] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 05:00:50 2022] DELETE /identity/v3/projects/e1637f6e48094653bebf0bc7af9aab9a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 05:00:50.526239 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:00:50.527634 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:00:50.540619 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dab9a2-e90b-4366-bad2-003460f71d46 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:00:50.595396 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:00:50.596249 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:00:50.596529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:00:50.596801 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] PATH_INFO: `/v3/users/46443eb1ed26466b93b9668f43fd7410` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:00:50.597994 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46443eb1ed26466b93b9668f43fd7410)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:00:50.600474 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:00:50.823044 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46443eb1ed26466b93b9668f43fd7410'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.823678 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46443eb1ed26466b93b9668f43fd7410'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.835390 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46443eb1ed26466b93b9668f43fd7410'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.842172 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46443eb1ed26466b93b9668f43fd7410'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.914586 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-e5b51659-b77b-4b4f-bab5-fef35254d037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46443eb1ed26466b93b9668f43fd7410'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:50.920600 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1450/2890] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 05:00:50 2022] DELETE /identity/v3/users/46443eb1ed26466b93b9668f43fd7410 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 05:00:51.175967 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:00:51.177409 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:00:51.191224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422ce4-e27c-48a0-a84d-41bd385d606c admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:00:51.248328 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:00:51.249181 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:00:51.249461 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:00:51.249734 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] PATH_INFO: `/v3/projects/c6431eaca81f44a4aee9a57824826628` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:00:51.251040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6431eaca81f44a4aee9a57824826628)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:00:51.252957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:00:51.356578 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6431eaca81f44a4aee9a57824826628', 'request_id': 'req-8ba3ab74-4c86-4033-accf-19176b37e8d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:51.425597 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6431eaca81f44a4aee9a57824826628', 'request_id': 'req-8ba3ab74-4c86-4033-accf-19176b37e8d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:51.432727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6431eaca81f44a4aee9a57824826628', 'request_id': 'req-8ba3ab74-4c86-4033-accf-19176b37e8d8'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:51.442783 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] The token cache is being invalidate because project c6431eaca81f44a4aee9a57824826628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 05:00:51.443116 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:51.443800 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:00:51.445479 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1441/2891] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 05:00:51 2022] DELETE /identity/v3/projects/c6431eaca81f44a4aee9a57824826628 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 05:01:01.140774 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2741-8135-4ae0-9dcd-0c194cbf6217 None None] REQUEST_METHOD: `POST` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:01:01.141273 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2741-8135-4ae0-9dcd-0c194cbf6217 None None] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:01:01.141383 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2741-8135-4ae0-9dcd-0c194cbf6217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:01:01.159030 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.auth.core [None req-8f0a2741-8135-4ae0-9dcd-0c194cbf6217 None None] MFA Rules not processed for user `bcaad1042b434b5a8ff8f3a0acc585ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 05:01:01.160252 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-8f0a2741-8135-4ae0-9dcd-0c194cbf6217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:01:01.214542 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1451/2892] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 05:01:01.521342 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:01:01.522728 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:01:01.576620 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ab74-4c86-4033-accf-19176b37e8d8 admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:01:01.580160 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:01:01.580780 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:01:01.581055 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:01:01.581326 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:01:01.583060 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:01:01.592645 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:01:01.594040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:01:01.602460 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1442/2893] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:01:09.349690 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2741-8135-4ae0-9dcd-0c194cbf6217 None None] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:01:09.359348 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2741-8135-4ae0-9dcd-0c194cbf6217 None None] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:01:09.363063 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:01:09.363693 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:01:09.363992 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:01:09.364517 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:01:09.366311 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:01:09.435220 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:01:09.436656 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:01:09.447970 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1452/2894] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:01:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:01:21.095614 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:01:21.104212 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5311c-4dfd-4803-b963-03261ca96abf service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:01:21.107809 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5279f24-188c-4e5a-839f-5fb663f39534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:01:21.108440 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279f24-188c-4e5a-839f-5fb663f39534 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:01:21.108720 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279f24-188c-4e5a-839f-5fb663f39534 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:01:21.108997 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5279f24-188c-4e5a-839f-5fb663f39534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:01:21.110758 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a5279f24-188c-4e5a-839f-5fb663f39534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:01:21.121190 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5279f24-188c-4e5a-839f-5fb663f39534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:01:21.122601 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5279f24-188c-4e5a-839f-5fb663f39534 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:01:21.130508 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1443/2895] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:01:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:03:09.647450 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:03:09.648997 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:09.702535 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef6fd2-ee89-4946-9865-95ca58a656c2 service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:03:09.706189 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6b83d1d42045bdad91bf814b54a7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:03:09.706839 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:03:09.707126 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:03:09.707398 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:03:09.709692 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:09.720120 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:03:09.721540 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:03:09.731157 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1453/2896] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:03:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:03:21.145014 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] REQUEST_METHOD: `POST` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:03:21.145542 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:03:21.145650 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:03:21.164300 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.auth.core [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] MFA Rules not processed for user `bcaad1042b434b5a8ff8f3a0acc585ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 31 05:03:21.165471 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:21.172120 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1444/2897] 10.222.0.21 () {58 vars in 957 bytes} [Mon Jan 31 05:03:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 31 05:03:22.164054 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:03:22.165529 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:22.233645 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20269395-a80f-4f68-b399-e59ff51da66b service cinder] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:03:22.238763 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:03:22.239479 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:03:22.239759 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:03:22.240029 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:03:22.241880 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:22.252869 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:03:22.254429 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:03:22.264808 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1454/2898] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:03:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:03:25.862255 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:03:25.863789 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:25.881681 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04f914-5a27-483c-bed7-3d6c4dd6fed4 None None] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:03:25.889040 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:03:25.889748 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:03:25.890034 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:03:25.890305 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:03:25.892115 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:25.905725 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:03:25.907373 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:03:25.918543 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1445/2899] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:03:38.526826 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:03:38.539648 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33756ea6-139f-46b9-b59a-22897389920a service placement] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:03:38.545263 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:03:38.545905 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:03:38.546305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:03:38.546646 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:03:38.548476 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:38.561958 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:03:38.565343 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:03:38.574665 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1455/2900] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:03:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:03:41.129965 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:03:41.154900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620cc89-0200-42e6-8ffc-fa9fff8ad938 service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:03:41.154900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:03:41.154900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:03:41.154900 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:03:41.155348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:03:41.155348 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:03:41.207122 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:03:41.208550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:03:41.218382 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1446/2901] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:03:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:04:43.459435 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:04:43.460941 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:04:43.475164 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a9a8-edb0-423a-aece-96939aafb247 service nova] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:04:43.480154 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:04:43.480798 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:04:43.481098 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:04:43.481885 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:04:43.483680 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:04:43.495013 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:04:43.496772 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:04:43.506962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1456/2902] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:04:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:05:33.431637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:05:33.431637 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:33.444516 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cbdfc-5334-4571-aada-9428e461ad38 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:05:33.450313 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf69b08068054c4180f2d44c9c07cb60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:05:33.451264 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:05:33.451607 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:05:33.451954 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:05:33.454087 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:33.467010 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:05:33.468718 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:05:33.479880 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1447/2903] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:05:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:05:35.073765 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:05:35.075819 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:35.087027 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adeda0-fd78-4479-996f-9370ce19d582 service placement] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:05:35.090537 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:05:35.091869 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:05:35.092222 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:05:35.092494 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:05:35.094203 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:35.107780 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:05:35.109445 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:05:35.119991 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1457/2904] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:05:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:05:48.829260 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:05:48.838419 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b0e6b-0b5a-4691-8856-0fbb0840f898 service nova] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:05:48.841986 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '889a6422677047b6a75d1480f156ead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:05:48.842604 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] REQUEST_METHOD: `GET` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:05:48.842918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:05:48.843194 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:05:48.844922 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:48.905550 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:05:48.907002 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:05:48.916205 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1448/2905] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 31 05:05:55.751384 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:05:55.752786 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:55.767985 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743991f-6feb-4af6-a1aa-21ed8948430b service neutron] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:05:55.772539 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:05:55.773389 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:05:55.773666 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:05:55.773935 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] PATH_INFO: `/v3/users/bcaad1042b434b5a8ff8f3a0acc585ec` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:05:55.775162 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcaad1042b434b5a8ff8f3a0acc585ec)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:05:55.777083 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:05:55.923003 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcaad1042b434b5a8ff8f3a0acc585ec'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:55.923596 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcaad1042b434b5a8ff8f3a0acc585ec'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:55.935289 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcaad1042b434b5a8ff8f3a0acc585ec'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:55.941908 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcaad1042b434b5a8ff8f3a0acc585ec'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.104609 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcaad1042b434b5a8ff8f3a0acc585ec'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.111805 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1458/2906] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 05:05:55 2022] DELETE /identity/v3/users/bcaad1042b434b5a8ff8f3a0acc585ec => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 05:05:56.323445 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:05:56.333727 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877c747-308a-4b52-be31-f00e7bf3bda8 service neutron] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:05:56.391354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:05:56.392224 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:05:56.392501 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:05:56.392775 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] PATH_INFO: `/v3/projects/4cf3ab219d9f44e1ab973f1d63347066` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:05:56.393976 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf3ab219d9f44e1ab973f1d63347066)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:05:56.395918 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:05:56.474654 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf3ab219d9f44e1ab973f1d63347066', 'request_id': 'req-b9dec613-fa8a-425f-b21b-18c8de1bdafe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.532688 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf3ab219d9f44e1ab973f1d63347066', 'request_id': 'req-b9dec613-fa8a-425f-b21b-18c8de1bdafe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.538848 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf3ab219d9f44e1ab973f1d63347066', 'request_id': 'req-b9dec613-fa8a-425f-b21b-18c8de1bdafe'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.549071 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] The token cache is being invalidate because project 4cf3ab219d9f44e1ab973f1d63347066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 05:05:56.549354 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.549977 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.551506 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1449/2907] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 05:05:56 2022] DELETE /identity/v3/projects/4cf3ab219d9f44e1ab973f1d63347066 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 05:05:56.555588 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:05:56.557015 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:56.570672 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987735-9b63-4f80-accd-e2abd3410fba admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:05:56.625721 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:05:56.626565 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:05:56.626873 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:05:56.627168 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] PATH_INFO: `/v3/users/a4f3348e999b41c28b56a945f10b4fdb` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:05:56.628379 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f3348e999b41c28b56a945f10b4fdb)` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:05:56.630284 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:05:56.799048 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f3348e999b41c28b56a945f10b4fdb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.802682 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f3348e999b41c28b56a945f10b4fdb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.812226 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f3348e999b41c28b56a945f10b4fdb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.818886 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f3348e999b41c28b56a945f10b4fdb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.864305 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.notifications [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f3348e999b41c28b56a945f10b4fdb'} {{(pid=79338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:56.870962 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1459/2908] 10.222.0.21 () {58 vars in 1223 bytes} [Mon Jan 31 05:05:56 2022] DELETE /identity/v3/users/a4f3348e999b41c28b56a945f10b4fdb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 31 05:05:57.117495 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Authenticating user token {{(pid=79339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:05:57.119235 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.fernet_utils [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:05:57.136957 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dec613-fa8a-425f-b21b-18c8de1bdafe admin admin] Validating token access rules against request {{(pid=79339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:05:57.193956 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2797021a13d04785b82a692e77ce62df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6434f6a5574340a59ffe3c6ae995c685', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:05:57.194881 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:05:57.195162 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] SCRIPT_NAME: `/identity` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:05:57.195433 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] PATH_INFO: `/v3/projects/b985a28524c94a7eb30396bfb0844e08` {{(pid=79339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:05:57.196638 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b985a28524c94a7eb30396bfb0844e08)` {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:05:57.198553 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] RBAC: Authorization granted {{(pid=79339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:05:57.292455 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b985a28524c94a7eb30396bfb0844e08', 'request_id': 'req-c5edaa8f-87b8-4e74-ae50-20538fd1849e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:57.350125 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b985a28524c94a7eb30396bfb0844e08', 'request_id': 'req-c5edaa8f-87b8-4e74-ae50-20538fd1849e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:57.356386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b985a28524c94a7eb30396bfb0844e08', 'request_id': 'req-c5edaa8f-87b8-4e74-ae50-20538fd1849e'} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:57.367386 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] The token cache is being invalidate because project b985a28524c94a7eb30396bfb0844e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 31 05:05:57.367672 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:57.368294 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: DEBUG keystone.notifications [None req-c5edaa8f-87b8-4e74-ae50-20538fd1849e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 31 05:05:57.369795 dv-cinder-826608-2-iscsi devstack@keystone.service[79339]: [pid: 79339|app: 0|req: 1450/2909] 10.222.0.21 () {58 vars in 1232 bytes} [Mon Jan 31 05:05:57 2022] DELETE /identity/v3/projects/b985a28524c94a7eb30396bfb0844e08 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 31 05:09:47.452012 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Authenticating user token {{(pid=79338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 31 05:09:47.453421 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:09:47.587062 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a452a-d1e7-49b8-ae5b-2399b2c887a6 admin admin] Validating token access rules against request {{(pid=79338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 31 05:09:47.642670 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe35ef-dfd7-4b5d-80bf-2ea7d53638ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266e2e8a599a4348aa356c18e3d7f3f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78afae1e6cc64db988476a8e22b35517', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 31 05:09:47.643333 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe35ef-dfd7-4b5d-80bf-2ea7d53638ac service placement] REQUEST_METHOD: `GET` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 31 05:09:47.643615 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe35ef-dfd7-4b5d-80bf-2ea7d53638ac service placement] SCRIPT_NAME: `/identity` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 31 05:09:47.643887 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe35ef-dfd7-4b5d-80bf-2ea7d53638ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 31 05:09:47.645652 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.fernet_utils [None req-3afe35ef-dfd7-4b5d-80bf-2ea7d53638ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 31 05:09:47.656519 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe35ef-dfd7-4b5d-80bf-2ea7d53638ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 31 05:09:47.658079 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe35ef-dfd7-4b5d-80bf-2ea7d53638ac service placement] RBAC: Authorization granted {{(pid=79338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 31 05:09:47.667618 dv-cinder-826608-2-iscsi devstack@keystone.service[79338]: [pid: 79338|app: 0|req: 1460/2910] 10.222.0.21 () {60 vars in 1365 bytes} [Mon Jan 31 05:09:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)